-- Logs begin at Wed 2022-05-04 14:05:05 UTC, end at Wed 2022-05-04 15:09:20 UTC. -- May 04 14:34:54.159579 dv-cinder-840493-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 04 14:34:54.167575 dv-cinder-840493-1-smb devstack@keystone.service[86292]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 14:34:54 2022] *** May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: nodename: dv-cinder-840493-1-smb May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: machine: x86_64 May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: clock source: unix May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: pcre jit disabled May 04 14:34:54.169719 dv-cinder-840493-1-smb devstack@keystone.service[86292]: detected number of CPU cores: 4 May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: current working directory: / May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: detected binary path: /usr/bin/uwsgi-core May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: your processes number limit is 47680 May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: your memory page size is 4096 bytes May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: detected max file descriptor number: 2048 May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: lock engine: pthread robust mutexes May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: thunder lock: enabled May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 14:34:54.170167 dv-cinder-840493-1-smb devstack@keystone.service[86292]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 14:34:54.215475 dv-cinder-840493-1-smb devstack@keystone.service[86292]: Python main interpreter initialized at 0x55b20ae089c0 May 04 14:34:54.215475 dv-cinder-840493-1-smb devstack@keystone.service[86292]: python threads support enabled May 04 14:34:54.215475 dv-cinder-840493-1-smb devstack@keystone.service[86292]: your server socket listen backlog is limited to 100 connections May 04 14:34:54.215475 dv-cinder-840493-1-smb devstack@keystone.service[86292]: your mercy for graceful operations on workers is 90 seconds May 04 14:34:54.215908 dv-cinder-840493-1-smb devstack@keystone.service[86292]: mapped 403077 bytes (393 KB) for 2 cores May 04 14:34:54.215908 dv-cinder-840493-1-smb devstack@keystone.service[86292]: *** Operational MODE: preforking *** May 04 14:34:54.216233 dv-cinder-840493-1-smb devstack@keystone.service[86292]: *** uWSGI is running in multiple interpreter mode *** May 04 14:34:54.216233 dv-cinder-840493-1-smb devstack@keystone.service[86292]: spawned uWSGI master process (pid: 86292) May 04 14:34:54.216465 dv-cinder-840493-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 04 14:34:54.223911 dv-cinder-840493-1-smb devstack@keystone.service[86292]: spawned uWSGI worker 1 (pid: 86302, cores: 1) May 04 14:34:54.223911 dv-cinder-840493-1-smb devstack@keystone.service[86292]: spawned uWSGI worker 2 (pid: 86303, cores: 1) May 04 14:34:54.223911 dv-cinder-840493-1-smb devstack@keystone.service[86292]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 14:34:59.886728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 14:34:59.886728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: from cryptography.utils import int_from_bytes May 04 14:34:59.887527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 14:34:59.887527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: from cryptography.utils import int_from_bytes May 04 14:34:59.892897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 14:34:59.892897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: from cryptography.utils import int_from_bytes May 04 14:34:59.893365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 14:34:59.893365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: from cryptography.utils import int_from_bytes May 04 14:34:59.936917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 14:34:59.937119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 14:34:59.937321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] command line args: [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 14:34:59.937515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 14:34:59.937680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ================================================================================ {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 14:34:59.937960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] admin_token = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.938164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] config_dir = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.938384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.938582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] config_source = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.938728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] debug = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.938935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_config_append = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.940938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.941141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_dir = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.941333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_file = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.941434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.941693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 14:34:59.942049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.942242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 14:34:59.942427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.942609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] command line args: [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 14:34:59.942793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.942988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 14:34:59.943172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.943375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ================================================================================ {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 14:34:59.943561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.943808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] admin_token = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.943975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.944200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] config_dir = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.944365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.944552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.944742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.944927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] config_source = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] debug = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.945946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_config_append = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.946897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.947337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.947470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_dir = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.947605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] publish_errors = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.947771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_file = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.947903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.948794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] standard_threads = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.949944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] use_journal = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] use_json = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] use_stderr = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.950890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] use_syslog = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.951755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.951889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.952014 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.952147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.952147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.952147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.952497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.952497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] publish_errors = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.952753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.952878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.953007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.953131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.953260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.953393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.953517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.953646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.953775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.953775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.954020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.954153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.954153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.954445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] standard_threads = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.954570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.954694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.954962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.954962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.955235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.955359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.955526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.955659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.955901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] use_journal = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.956029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.956154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] use_json = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.956283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.956422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] use_stderr = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.956613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.956754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] use_syslog = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.956754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 14:34:59.956994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.957908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.958943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.959100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.959254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.959452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.959615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.959862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.960963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.961979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.962831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.963946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.964965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.965987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.966978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.967101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.967224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.967224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.967224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.967580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.968964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.969318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.969505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.969725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.969725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.970063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.970259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.970445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.970629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.970855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.971014 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.971208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.971395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.971583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.972965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.973253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.973452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.973635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.973831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.973995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.974984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975109 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.975969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.976355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.977945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.978954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.979945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.external = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.980998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.password = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] auth.token = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.981921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.982947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.983886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.984911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.985968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.986986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.987885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.external = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.988990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.password = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] auth.token = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.989955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.990980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.991949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.992927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.993733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.994805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.995915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.996339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.996339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.996539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.996619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.996772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.997954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.998969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:34:59.999948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.000897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.001873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.002957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.003985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.004176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.004443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.004577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.004701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.004904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005161 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.005942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.006994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.007974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.008888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.009899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.010933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.011936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] role.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.012876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] role.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.013936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.014976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.015956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.016949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.017948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.018853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.019850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.020988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.021884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.022855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.023978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.024950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.connection = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] role.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.025906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] role.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.026931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.027986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.028105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.028528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.028761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.028893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.029883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.030028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 14:35:00.030148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.030402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.030720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.031037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.031361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.031696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.032194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.032500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.032819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.033139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.033457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.033776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.034080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.034406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.034728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.035037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.035338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.035714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.036013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.036338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.036664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.036983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.037292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.037600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.037901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.038207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.038517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.038834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.039141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.039469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.039806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.040114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.040433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.040745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.041061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.041367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.041678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.041983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.042297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.042617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.042917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.043229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.043594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.043947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.connection = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.044264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.044584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.044895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.045207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.045514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.045820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.046124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.046428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.046742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.047047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.047359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.047713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.047996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.048300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.048614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.048912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.049220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.049530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 14:35:00.049766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 14:35:00.061235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.061515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.061654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.072387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.077404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.077711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.078012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.087074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.104331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.104577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.105862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.106168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.160736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.161990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.213676 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.213993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.218691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.218909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.284379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.284670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.284983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.285278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.285480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.285622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.285751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.285877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.286002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.286154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.286281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.286406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.310054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.310345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.310507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.310507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.310906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.311704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.312071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.312377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.323414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.323803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.339559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.339872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.340038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.340178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.340365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.340591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.340591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.341509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.342235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86303) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 14:35:00.358381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.358588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 14:35:00.358680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.358785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 14:35:00.358923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 14:35:00.359327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 14:35:00.359410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.359963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.360131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.360227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.360381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.371992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.372067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.372239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.380118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.383363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.383634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.383934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.384329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.384589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.384743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.384875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.385097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.385367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.385634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.385901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.386163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.388201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.388484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.388915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.389203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.389489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.389752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.390024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.390299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.390571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.390843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.391108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.413172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.414708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.414990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.419343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.420269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.420540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.420812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.421051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.421333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.426760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.427038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.427319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.428134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.428413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.433045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.433307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.433598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.433871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.434108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.434394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.434607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.434896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.435700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.435986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.440676 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.441022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.441309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.441591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.441917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.442193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.442414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.442713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.453450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.453702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.458225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.461435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.461723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.461937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.462083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.467079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.467289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.470623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.470823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.470970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.474390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.474680 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.474935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.475233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.475506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.475765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.476071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.479917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.483655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.483976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.484262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.484547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.484802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.485099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.494677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.495218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.495410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.495574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.503387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.505158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.505400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.505994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.506527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.506882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.507227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.508450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.508699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.509010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.509293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.509560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.515332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.517078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.517326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.521367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.521637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.521897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.522180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.522465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.528927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.529195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.529496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.529769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.530010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.530291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.530566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.536431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.536731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.537007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.537261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.537563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.537832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.538102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.549214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.552627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.556099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.558090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.558291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.559968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.560530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.560530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.561491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.564860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.566458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.568158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.568418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.568720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.569092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.570674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.573865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.574122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.574427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.574699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.576152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.577752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.581694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.582138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.582456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.582743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.583944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.584242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.584529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.592339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.592639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.592922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.594431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.594677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.594996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.595273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.595511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.595841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.596076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.596566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.596722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.596857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.597145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.597414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.597621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.597906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.601179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86303) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 14:35:00.601442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.601749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.602037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.602309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.602582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.602852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.603124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.603369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.603710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.604046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.604293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.604567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.605020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86303) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 14:35:00.637870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b20ae089c0 pid: 86302 (default app) May 04 14:35:00.641384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eddd0-047e-400a-9c77-a8d77f21f022 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:00.641682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eddd0-047e-400a-9c77-a8d77f21f022 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:00.641958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eddd0-047e-400a-9c77-a8d77f21f022 None None] PATH_INFO: `/v3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:00.646850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b20ae089c0 pid: 86303 (default app) May 04 14:35:00.647059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Wed May 4 14:35:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:08.725994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:08.726726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:08.726726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:08.727974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:08.736147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:08.736739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:08.736739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:08.769341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG oslo_db.sqlalchemy.engines [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 14:35:08.958471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG passlib.handlers.bcrypt [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86303) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 14:35:08.958897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG passlib.handlers.bcrypt [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86303) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 14:35:09.015360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:09.017039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:09.148168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1/3] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 14:35:09.331029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:09.366543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG oslo_db.sqlalchemy.engines [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 14:35:09.493633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3ac2-ea8f-4712-a9e8-751e5d0a16f8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:09.498391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:09.499054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:09.499332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:09.499602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:09.508324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:09.559482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 14:35:09.559838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a37f6-5539-4e88-80d9-aaa9b46bf8b2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:09.569916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 3/4] 10.222.0.21 () {58 vars in 1324 bytes} [Wed May 4 14:35:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:35:09.576324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:09.591558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3c070-a0bf-4bed-bfeb-01d1a657af9a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:09.596455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:09.597600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:09.597932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:09.598213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] PATH_INFO: `/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:09.599819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] RBAC: Authorizing `identity:get_project(project_id=e3035cf84fc44f4baa2938e61d4c1c06)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:09.650329 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 14:35:09.650671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952be1-3949-4448-bdf0-51f4791e4262 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:09.656066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 2/5] 10.222.0.21 () {56 vars in 1207 bytes} [Wed May 4 14:35:09 2022] GET /identity/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:11.913247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32942-3734-4287-848f-cbb0f2c4557e None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:11.913833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32942-3734-4287-848f-cbb0f2c4557e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:11.913833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32942-3734-4287-848f-cbb0f2c4557e None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:11.917967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 4/6] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:11.924132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:11.924643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:11.924742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:11.946577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:11.948194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:11.957065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 3/7] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 04 14:35:11.979707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c32942-3734-4287-848f-cbb0f2c4557e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:11.996752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c32942-3734-4287-848f-cbb0f2c4557e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:12.001449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:12.002098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:12.002380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:12.002659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:12.012131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:12.014094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e71ab9-c282-4af3-81da-ada98995f6be admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:12.024643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 5/8] 10.222.0.21 () {58 vars in 1324 bytes} [Wed May 4 14:35:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:35:12.031296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:12.043942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478b13-bdb7-4bf9-b3b1-08731b155470 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:12.048982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:12.049852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:12.050121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:12.050392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:12.053870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:12.055783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23e14-1ac6-490e-83a3-0cc2baef2e69 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:12.057452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 4/9] 10.222.0.21 () {56 vars in 1198 bytes} [Wed May 4 14:35:12 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:14.432997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742b9e-f70a-45b2-ab51-ce4789c47bd3 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.433583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742b9e-f70a-45b2-ab51-ce4789c47bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.433583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742b9e-f70a-45b2-ab51-ce4789c47bd3 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.434994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:14.440567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.441000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.441104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.445154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538773-535a-4831-8562-0a292d91ce4e None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.445563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538773-535a-4831-8562-0a292d91ce4e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.445935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538773-535a-4831-8562-0a292d91ce4e None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.448216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 7/11] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:14.455507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.455957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.456383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.499073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG passlib.handlers.bcrypt [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86302) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 14:35:14.499472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG passlib.handlers.bcrypt [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86302) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 14:35:14.546645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:14.548323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:14.574891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:14.576140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:14.692161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 5/12] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:14.702083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 8/13] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:14.721634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:14.728722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:14.839295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64ef6-33e5-4258-8aee-5f5523ce2059 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:14.854217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb107e6-e1e6-43db-ba32-25ee4f853841 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:14.888775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:14.889665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.889995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.890339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.901253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:14.902182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:14.902455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:14.902606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:14.902695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:14.914285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:14.915476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:14.916375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 6/14] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:14.921454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:14.976574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:14.978028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.029782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfadf-03c0-4488-89e6-8b4a84812849 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.075684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.076385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.076661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.076934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.077688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:15.077991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.079419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.085933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 9/15] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:35:15.091703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 7/16] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:15.091894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:15.098513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:15.217399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d471-7a47-45ae-9e98-74f6e6c8daba None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.254260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.255050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.255318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.255589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.256890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.258372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.260271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 8/17] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:15 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:15.265594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:15.312798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7b8e1-af67-4595-825c-7195b7872752 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.349144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.349982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.350263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.350537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.369637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.371160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.374808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775156-1ec3-40ce-b0f5-ac67ad3b2abb None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:35:15.391461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:15.392384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:15.393250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:35:15.393250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:35:15.393250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:35:15.393250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:15.393250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 10/18] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:15.398798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:15.410409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.411216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.411652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.411977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.413323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.415727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.418320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 9/19] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:15.426938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:15.506951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abf36-56f6-44e7-8767-b1ed99193087 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.533323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00216a3-12e2-44d9-8e3a-9277d7f36f4e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:15.545915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.546602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.546880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.547152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.547946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:15.548255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.549742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28318f32-d3ac-428f-88e6-ee39d9efbfb7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.567595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:15.568284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:15.568595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:15.568866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:15.569706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.domain.id=default, user.id=e2fff94fab47494ebebc775758ec7bee) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:15.569997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:15.570669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 11/20] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:15.571551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8149-2177-4fd9-9ac5-1690aae816ed None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:15.578992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 10/21] 10.222.0.21 () {56 vars in 1322 bytes} [Wed May 4 14:35:15 2022] GET /identity/v3/role_assignments?user.id=e2fff94fab47494ebebc775758ec7bee&scope.domain.id=default&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:18.306283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91428b-eedc-427c-a09a-43b235b106b1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.307563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91428b-eedc-427c-a09a-43b235b106b1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.308129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91428b-eedc-427c-a09a-43b235b106b1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.310782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 12/22] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:18.316926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07989-3289-4695-8887-6d1072c413f6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.317840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07989-3289-4695-8887-6d1072c413f6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.318300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07989-3289-4695-8887-6d1072c413f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.352809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9ad07989-3289-4695-8887-6d1072c413f6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:18.354023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9ad07989-3289-4695-8887-6d1072c413f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:18.441163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 11/23] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:18.465924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40093-c75e-41fa-8f74-a02dfe013a49 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.466547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40093-c75e-41fa-8f74-a02dfe013a49 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.467010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40093-c75e-41fa-8f74-a02dfe013a49 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.468890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:18.475014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.475330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.475566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.475907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40093-c75e-41fa-8f74-a02dfe013a49 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:18.498141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:18.499626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:18.592312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 12/25] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:18.633651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40093-c75e-41fa-8f74-a02dfe013a49 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:18.684446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:18.690277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:18.691565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.692080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.692558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.713620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:18.727266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:18.728221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:18.728981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:18.740187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 14/26] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:18.745711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:18.885375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2da870-0f3d-4b07-b3e8-9c99c576e60d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:18.924525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:18.925342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.925619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.925950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.942037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:18.943956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:18.956440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133d32a-eb40-4ece-af62-87f9b8fa3803 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-06abd1e2-e442-4f80-9816-5b55795088b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:35:18.975927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:18.976909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:18.978241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:35:18.978241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:35:18.978241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:35:18.978241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:18.978241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 13/27] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:18.978528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1fba-ab1b-45ef-8a38-5bfd9c1af14f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.978801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1fba-ab1b-45ef-8a38-5bfd9c1af14f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.979210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1fba-ab1b-45ef-8a38-5bfd9c1af14f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.981141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 14/28] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:18.982475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dde1-abbc-4a85-960e-18f4e36833a8 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.982897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dde1-abbc-4a85-960e-18f4e36833a8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.983302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dde1-abbc-4a85-960e-18f4e36833a8 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:18.985056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 15/29] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:18.989352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc44fea-2583-4243-8453-6a9fa6a8b688 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:18.991284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc44fea-2583-4243-8453-6a9fa6a8b688 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:18.991284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc44fea-2583-4243-8453-6a9fa6a8b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.002085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.003650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.004016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.004289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.005100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:19.005407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.006918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.010635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9fc44fea-2583-4243-8453-6a9fa6a8b688 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:19.012812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9fc44fea-2583-4243-8453-6a9fa6a8b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:19.021727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 15/30] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:19.022847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.084623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 16/31] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:19.086355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.086848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.087310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.121901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:19.123386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:19.127269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf992-b52e-43c0-bd1a-3d42954a99c7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.170773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.171829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.172295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.172767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.174048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:19.174538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.177016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.194474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 17/32] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:19.196850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.196980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 16/33] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:19.197365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.307828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d4a7-72c7-4cf3-9b06-856b03951f24 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.327103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f014f2-67d8-48be-8f39-dce08112e0cc None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.355066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.356179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.356656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.357121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.358073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.359739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.366992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.368678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.369213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.369660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.371635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.373636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.376170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 18/34] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:19 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:19.377199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.480354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea32a57-006b-4871-9b3a-69362a6eee14 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.491847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 17/35] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:19.493042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.530602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.531719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.532203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.532698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.533649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.535504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.727913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12fd1f-5ccf-42e7-980c-85e29f0f79d5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.728552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 19/36] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/projects => generated 301 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:19.730074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.776945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.777688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.777976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.778591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.780246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.785023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dda18e-102c-4790-82ff-b62f336d94b5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.804727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:19.807136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cf1e-ac24-46eb-b1b5-943e8c135f4f None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.807544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cf1e-ac24-46eb-b1b5-943e8c135f4f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.807932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cf1e-ac24-46eb-b1b5-943e8c135f4f None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.809880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 19/38] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:19.816061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b363e-2183-4312-85de-c6553584fd1a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.816565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b363e-2183-4312-85de-c6553584fd1a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.817010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b363e-2183-4312-85de-c6553584fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.842350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-785b363e-2183-4312-85de-c6553584fd1a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:19.847341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-785b363e-2183-4312-85de-c6553584fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:19.884649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e134a8-9cdb-4596-850d-73f3b86b21e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:19.945579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:19.945579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:19.945579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:19.945579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:19.946959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:19.948362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:19.950146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 20/39] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:19.958289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:19.959523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 20/40] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:19.991316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b363e-2183-4312-85de-c6553584fd1a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:20.085059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40712bc-5fa1-469f-a43e-ac0cfe7ad50a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:20.114583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b363e-2183-4312-85de-c6553584fd1a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:20.123574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:20.124268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.124553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.124888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] PATH_INFO: `/v3/domains/default/users/e2fff94fab47494ebebc775758ec7bee/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.127201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e2fff94fab47494ebebc775758ec7bee, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:20.129213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9dff8-624c-4b82-944c-23760d9f1ade None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:20.150016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 21/41] 10.222.0.21 () {58 vars in 1361 bytes} [Wed May 4 14:35:19 2022] PUT /identity/v3/domains/default/users/e2fff94fab47494ebebc775758ec7bee/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:20.151635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600123-f8d5-4fcb-8eb8-ec1625fc51f5 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.151999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600123-f8d5-4fcb-8eb8-ec1625fc51f5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.152289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600123-f8d5-4fcb-8eb8-ec1625fc51f5 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.154033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 22/42] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:20.163153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.163440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.163767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.174640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:20.175513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.175983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.176366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.177303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:20.179001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:20.182791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:20.184498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:20.199560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 21/43] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 14:35:19 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:20.284281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 23/44] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:20.307692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:20.429214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafe88-d6d0-4684-a7ff-c420bf142c6b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:20.462472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:20.463292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.463575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.463884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.465395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:20.466924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895d4c5-5f0c-4637-be24-f047375afde6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:20.468814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 22/45] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:20.474421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:20.582459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b51a0f-9ffa-4300-b9a9-18a2e74db11e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:20.620831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:20.621434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:20.621719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:20.621995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:20.622752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:20.624279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61f098-cb99-4e08-9e8f-450106477c54 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:20.659762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:35:20 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:22.443807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4594-d764-4a68-9a9a-d68adcb4ab2f None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.444393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4594-d764-4a68-9a9a-d68adcb4ab2f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.444393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4594-d764-4a68-9a9a-d68adcb4ab2f None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.445730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 23/47] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:22.451213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.451606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.451807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.469590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:22.470798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:22.540384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 25/48] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:22.563469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4594-d764-4a68-9a9a-d68adcb4ab2f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:22.664754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4594-d764-4a68-9a9a-d68adcb4ab2f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:22.699756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:22.700583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.700873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.701145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.711686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:22.719337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:22.720339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:22.721134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 24/49] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:22.728040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:22.840455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7f737-bfdf-4171-a197-67e30d1717e2 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:22.875304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:22.876022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.876302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.876577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.877370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:22.877674 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:22.879059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad667bb6-8bb7-4147-b080-00022e3f1110 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:22.887163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 26/50] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:22.892863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:22.938018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc071-2969-4b36-bbba-81c13cdf14de None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.938201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc071-2969-4b36-bbba-81c13cdf14de None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.938505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc071-2969-4b36-bbba-81c13cdf14de None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.940015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 27/51] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:22.945235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:22.945498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:22.945780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:22.963570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:22.964779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:23.000986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2af12-0027-4c91-a2a1-0aed700a924e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:23.037876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 28/52] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:23.047260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:23.048200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:23.048483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:23.048759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:23.050339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:23.051907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:23.053805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 25/53] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:22 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:23.059473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:23.061124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:23.170218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313213-dabc-465b-9fb0-1982da1c3aab None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:23.170469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85792a-e46b-40a4-aafb-fa51e14715a2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:23.208242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:23.208456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:23.208979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:23.209110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:23.209267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:23.209394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:23.209508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:23.209599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:23.210851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:23.210991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:23.212413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:23.212556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:23.214314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 29/55] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:23.214483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 26/55] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:23.219971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:23.220134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:23.324955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30be7-7521-4295-8ef9-8a07a7dd88d4 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:23.327446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c59b-ea3b-453f-ad2d-aceb5acb5487 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:23.362182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:23.362860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:23.363176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:23.363478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:23.364371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.domain.id=default, user.id=e2fff94fab47494ebebc775758ec7bee) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:23.364683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:23.366194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b00af-dabc-463b-a3ce-ffde5f789dd8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:23.369474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:23.370152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:23.370446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:23.370727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:23.371476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:23.372458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 30/56] 10.222.0.21 () {56 vars in 1322 bytes} [Wed May 4 14:35:23 2022] GET /identity/v3/role_assignments?user.id=e2fff94fab47494ebebc775758ec7bee&scope.domain.id=default&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:23.372998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec70800-875c-48af-b56c-03fb4d755fa7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:23.407205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 27/57] 10.222.0.21 () {60 vars in 1140 bytes} [Wed May 4 14:35:23 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:25.688231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebb6b1-009f-4686-ba91-c9272813e93e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:25.688793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebb6b1-009f-4686-ba91-c9272813e93e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:25.688793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebb6b1-009f-4686-ba91-c9272813e93e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:25.690248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 31/58] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:25.695611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:25.696063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:25.696187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:25.713430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:25.714615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:25.782918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 28/59] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:25.807435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebb6b1-009f-4686-ba91-c9272813e93e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:25.914147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebb6b1-009f-4686-ba91-c9272813e93e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:25.950021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:25.950873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:25.951175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:25.951489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:25.952946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:25.954632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2308559-f474-47cb-81c2-9977672a5ae3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:25.956992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 32/60] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:25.963646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:26.068523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aabdf-342e-4c91-9260-a0e059056679 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:26.102463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:26.103134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:26.103417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:26.103706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:26.104426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:26.105923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de001f-eb6c-400a-81b5-984952ddbc41 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:26.132979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 29/61] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:25 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:29.566684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556dce-af4b-43c7-ab78-e14841221de0 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.568089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556dce-af4b-43c7-ab78-e14841221de0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.568629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556dce-af4b-43c7-ab78-e14841221de0 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.570357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 33/62] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:29.576061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.577471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.578095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.608054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:29.609579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:29.631204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff2256-d831-4e5f-89c4-ab1ade784aa3 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.636745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff2256-d831-4e5f-89c4-ab1ade784aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.637764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff2256-d831-4e5f-89c4-ab1ade784aa3 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.643317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 34/63] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:29.650512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3f20-1088-4c07-a4a5-9308ea7c6503 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.651563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3f20-1088-4c07-a4a5-9308ea7c6503 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.652155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3f20-1088-4c07-a4a5-9308ea7c6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.683439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-53bd3f20-1088-4c07-a4a5-9308ea7c6503 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:29.685371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-53bd3f20-1088-4c07-a4a5-9308ea7c6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:29.748121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 30/64] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:29.769094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:29.849124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 35/65] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:29.851995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343092b9-a664-4100-900c-fa2b3c07d5ab None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.852535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343092b9-a664-4100-900c-fa2b3c07d5ab None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.853019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343092b9-a664-4100-900c-fa2b3c07d5ab None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.854562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 36/66] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:29.869186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.869749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.870235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.892292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:29.893736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:29.907440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdce35-8980-40c9-b96f-cf5f231f1434 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:29.941750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:29.942560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:29.942847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:29.943121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:29.954026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:29.962170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:29.963343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:29.964356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:29.965544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 37/67] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:29.966411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:29.966648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 31/68] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:29.984127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.094469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e95-2214-44d1-bf65-998084b1da91 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.095806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705e94c-445d-4148-bcb0-475491c60d47 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.129729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.129928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.130569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.130857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.131046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.131148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.131625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.132151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.133057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:30.133522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.135142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.142220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:30.145493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 32/69] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.146821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:30.156326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:30.157492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:30.158482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 38/70] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:30.165480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.261504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec78a6a-9e5b-4d1a-8eb6-78b9cb38ad0d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.271415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78760ec-fed4-4070-8a3c-37cf842d49bf None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.296170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.297287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.297561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.297835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.305813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.306720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.307002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.307275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.308482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:30.317034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:30.317984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:30.318796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 33/71] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:30.324049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.327330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.329096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd16a-318d-473a-97ff-6f18d30e2b39 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.335803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 39/72] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.335803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49c67-6d91-4318-bb71-4c37601d44ac None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.335803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49c67-6d91-4318-bb71-4c37601d44ac None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.335803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49c67-6d91-4318-bb71-4c37601d44ac None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.335803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 40/73] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:30.338873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea49c67-6d91-4318-bb71-4c37601d44ac None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.432504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a331-d668-405a-ad60-dec89aa387a9 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.439189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea49c67-6d91-4318-bb71-4c37601d44ac None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.468971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.469658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.469949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.470229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.470997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:30.471308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.471392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.472106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.472451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.472730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.472870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.473517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:30.473830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.475237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e7ae-c46d-4f80-8601-099b93723f89 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.483461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 41/74] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.484988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423df5-6473-42e9-8228-bf68960a080e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.485244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423df5-6473-42e9-8228-bf68960a080e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.485523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423df5-6473-42e9-8228-bf68960a080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.488973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 34/75] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.489844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.502750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-97423df5-6473-42e9-8228-bf68960a080e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:30.504069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-97423df5-6473-42e9-8228-bf68960a080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:30.574300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 42/76] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:30.575708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4fca2-993f-47cd-878f-0900fdd02b25 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.576204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4fca2-993f-47cd-878f-0900fdd02b25 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.576484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4fca2-993f-47cd-878f-0900fdd02b25 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.577957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 43/77] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:30.578458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4fca2-993f-47cd-878f-0900fdd02b25 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.590970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206735b7-910e-40cd-a2be-df71824bf6c0 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.624751 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.625422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.625753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.626019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.678118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4fca2-993f-47cd-878f-0900fdd02b25 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.691429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.692939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff808e-0c7b-458f-be73-609fc9b2271a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.711332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.712248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.712527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.712797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.713995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.715446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.717121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 44/78] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.717882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.786913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 35/79] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:30.791980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.791980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.791980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.805740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:30.806939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:30.838653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b24931-fd0b-4db4-9729-996b6fb5f1b5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.871438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 36/80] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:30.872387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.876082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:30.876995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:30.877276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:30.877552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:30.878823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:30.880350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:30.882034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 45/81] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:30.882833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:30.976143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4310f93-b07b-4417-a767-37b06b0d9fc5 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:30.983111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890e29-93fb-4be9-a7a4-2d48842ba381 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.009675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.010479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.010732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.011005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.021695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:31.024297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.024963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.025248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.025524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:31.029668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:31.030723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 37/82] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:31.031658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.105691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.107336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.129604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d7d5-fa14-4830-842e-e1af8468c57a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.164022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.164924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.165211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.165489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.166784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.168471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.170198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 38/83] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.171016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.207446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 46/84] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:31.208369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.266323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf7aa-c7ec-4657-89d3-43be04452585 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.300665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.301321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.301637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.301907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.308915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c7ac-3af2-4c0c-8ed5-5eb1e75253bd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.346255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.347079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.347363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.347756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.349064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.350579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.352315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 47/85] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.353328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.372865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.374422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.455691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7071b-e4df-47f6-b59e-4ab1aaeb16bf None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.473950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 39/86] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:31.474810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.491957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.492650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.492928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.493206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.493957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:31.494267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.495699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.504270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 48/87] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.505091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.574406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c60ed5-c53a-4941-b92a-85e87dea8f39 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.605398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bbc5-120b-4b20-b515-719523512c05 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.612567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.613707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.614004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.614289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.615219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:31.615519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.617116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.625816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 40/88] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=81b7812443324595b557a25ca9559d8d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.626640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.646356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.647274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.647561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.647922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.649294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.651366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.659470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 49/89] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.659470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.755028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f5bb-ae77-4946-b11b-1adac69e3e82 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.779743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88183b-1fb9-4e68-a9cd-e367996fa84c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.796962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.798120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.798548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.798921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.799840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.801523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.820087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.821149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.821529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.821904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.823276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.824690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 41/90] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:31 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:31.825073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.825247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.827788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 50/91] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.834464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:31.950489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78236-d652-4f48-8510-1f990baa157e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.952723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f4db4-5700-414e-95ae-4d63fec59214 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:31.989259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.990183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.990451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.990732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.992116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.993198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:31.993677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:31.994239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:31.994664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:31.995115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:31.995812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 42/92] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:31.997143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:31.997671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:31.999874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:32.001250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:32.008254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 51/93] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:32.009338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:32.126865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc17e7-7036-4cea-ac22-b273ce253ada None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:32.129043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07289c3c-c39c-456c-a655-6ff6cd741942 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:32.168747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:32.169851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:32.170243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:32.170420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:32.170836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:32.170952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:32.171188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:32.171469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:32.172417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=e2fff94fab47494ebebc775758ec7bee) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:32.172737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:32.174277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:32.181819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 43/94] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:31 2022] GET /identity/v3/role_assignments?user.id=e2fff94fab47494ebebc775758ec7bee&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:32.262617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:32.264330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:32.384703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 52/95] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:32.390734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:32.515542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5e838-6148-4c29-b19e-ac0fa699e3f1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:32.550944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:32.551867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:32.552156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:32.552440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] PATH_INFO: `/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:32.553684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] RBAC: Authorizing `identity:get_project(project_id=90a1d96dbfda4f89bf76c48aafa855ee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:32.555199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c313-c21b-4c23-bef1-05b758e466e0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:32.557301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 44/96] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:32 2022] GET /identity/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:32.562875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:32.701913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20195f-988f-4aec-aa56-847e83220055 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:32.738201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:32.738868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:32.739146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:32.739424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:32.740289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=90a1d96dbfda4f89bf76c48aafa855ee, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:32.740611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:32.742068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ba84-6880-4266-97cc-a604a12da845 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:32.748025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 53/97] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:32 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=90a1d96dbfda4f89bf76c48aafa855ee&role.id=81b7812443324595b557a25ca9559d8d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:34.970658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3219-c629-4cf7-8cc1-a753db3b744c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:34.971241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3219-c629-4cf7-8cc1-a753db3b744c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:34.971241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3219-c629-4cf7-8cc1-a753db3b744c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:34.973055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 45/98] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:34.978715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae95642-1982-4a74-8867-4794fe20401f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:34.979139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae95642-1982-4a74-8867-4794fe20401f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:34.979329 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae95642-1982-4a74-8867-4794fe20401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.004736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fae95642-1982-4a74-8867-4794fe20401f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:35.005953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fae95642-1982-4a74-8867-4794fe20401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:35.093742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 54/99] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:35.128499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3219-c629-4cf7-8cc1-a753db3b744c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.269483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3219-c629-4cf7-8cc1-a753db3b744c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.283294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3a68-ca47-4b44-81d8-aee9b6dac825 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.283622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3a68-ca47-4b44-81d8-aee9b6dac825 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.283872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3a68-ca47-4b44-81d8-aee9b6dac825 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.285552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 55/100] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:35.297976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cce-dd40-4d31-a595-958877409657 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.298258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cce-dd40-4d31-a595-958877409657 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.298536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cce-dd40-4d31-a595-958877409657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.326544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-498b2cce-dd40-4d31-a595-958877409657 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:35.326544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-498b2cce-dd40-4d31-a595-958877409657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:35.331230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.332167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.332444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.332714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.355577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:35.363809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:35.364743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:35.365538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:35.376147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 46/101] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:35.384996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.461006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 56/102] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:35.462677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0d8bd-5c2b-487c-bc15-3c7f5193829f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.463192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0d8bd-5c2b-487c-bc15-3c7f5193829f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.464153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0d8bd-5c2b-487c-bc15-3c7f5193829f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.465682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 57/103] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:35.473434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.474009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.474483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.505911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:35.507500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:35.554616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300064-2cb5-4e00-8363-36a139ef9f17 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.585951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 58/104] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:35.587199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.621413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.622101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.622381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.622654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.623425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:35.623758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:35.625218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:35.650949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 47/105] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:35.651912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.706106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cbb2a-06a8-429c-a451-47cd457677e6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.739846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.740666 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.740945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.741216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.751481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:35.756480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fc164-b74a-44fe-932d-23d9a588de99 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:35.759427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:35.760378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:35.761153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 59/106] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:35.761819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.796215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.797084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.797374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.797651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.799025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:35.800573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1134-f18f-454b-b38f-382a6d017a90 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:35.802226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 48/107] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:35.803604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee4c7-3e4a-4f43-9a26-83e1807b1ced None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.803928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee4c7-3e4a-4f43-9a26-83e1807b1ced None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.804204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee4c7-3e4a-4f43-9a26-83e1807b1ced None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.805651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 49/108] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:35.806200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbee4c7-3e4a-4f43-9a26-83e1807b1ced None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.864784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9803a2-6776-4d92-878e-efa8cd60688d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.898171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.899067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.899350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.899620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.900849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:35.902295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:35.904478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 60/109] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:35.905052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:35.912027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbee4c7-3e4a-4f43-9a26-83e1807b1ced None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:35.946692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:35.947388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.947694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.947966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.948745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:35.949060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:35.950567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfba310-c23f-47b1-a408-83e1382f6d92 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:35.963697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 50/110] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:35.963697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d967f-d594-47ae-a204-8fa14f8fe148 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:35.963697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d967f-d594-47ae-a204-8fa14f8fe148 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:35.963697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d967f-d594-47ae-a204-8fa14f8fe148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:35.978550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a24d967f-d594-47ae-a204-8fa14f8fe148 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:35.979884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a24d967f-d594-47ae-a204-8fa14f8fe148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:36.008121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfa88-e570-419d-82d5-8038cbeb0aa4 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.042072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.043174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.043704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.044773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 51/111] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:36.045179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a120-3834-41b4-817d-261136e66170 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.045470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a120-3834-41b4-817d-261136e66170 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.045741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a120-3834-41b4-817d-261136e66170 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.047132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 52/112] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:36.048547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2a120-3834-41b4-817d-261136e66170 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.055286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.056158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.057949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.084356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 61/113] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:35:35 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:36.092866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.159918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2a120-3834-41b4-817d-261136e66170 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.197826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.198759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.199004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.199281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.200817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.202232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d9f15-19da-4505-aa65-33c61346e5d6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.209074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 53/114] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:36.210578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.210883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.211147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.224037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c1aa-506e-4d0c-bcec-d7f8b374ac73 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.232521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:36.234862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:36.264848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.265938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.266331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.266652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.268402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.270233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.276923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 62/115] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:36.276923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.328984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 54/116] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:36.330138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.399414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5473a-9de0-419e-8435-36fc72cefff6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.439321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.440428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.440895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.441798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.453147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f90e-75fa-4e19-a8e7-b5376b1c3040 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.455284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:36.465670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:36.466640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:36.467415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 63/117] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:36.468124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.507540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.509171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.509648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.510103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.513860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, user_id=3bd206864bcc414c9408f8a1f6b0e30e, role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.516873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.544026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 55/118] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:36 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:36.545440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.586140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516457-8ae2-4951-ab80-927871f28bcc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.633935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.635097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.635608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.636077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.637625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.639625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5974cf2-c524-4835-96b2-4b7d73a4c6e8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.641858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 64/119] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:36.643784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13612a7-dd20-4efa-a378-6b1822678b6e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.644305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13612a7-dd20-4efa-a378-6b1822678b6e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.645282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13612a7-dd20-4efa-a378-6b1822678b6e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.647190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 65/120] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:36.648149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13612a7-dd20-4efa-a378-6b1822678b6e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.735823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593b39-1c6b-4c63-af35-511ad56a4a9d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.777805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.779228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.779701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.780130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.793171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:36.801163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:36.802256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:36.803103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:36.805409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 56/121] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:36.806437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.812433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13612a7-dd20-4efa-a378-6b1822678b6e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.859539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.860321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.860673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.861406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.862267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:36.862649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:36.864834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ce87-746a-4111-952d-a761d54d2145 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:36.875307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 66/122] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:36.881715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.882005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.882282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.902358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:36.903900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:36.946461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6a18-6377-4e13-b9a2-eb02d1d8d0b7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:36.973653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 67/123] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:36.974456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:36.993149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:36.994867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:36.995358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:36.995873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:36.998340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, user_id=3bd206864bcc414c9408f8a1f6b0e30e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.000195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.024992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 57/124] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:36 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:37.026356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.086211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e510c-8c3c-461b-a449-02f14aaf0922 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.122516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.123109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.123392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.123680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.124465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:37.124775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.126690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.135646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 68/125] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.136634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.145446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ebd-a754-4471-b0de-1be1fd13721e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.183478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.184826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.185348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.185832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] PATH_INFO: `/v3/users/d7917245cbef4b4b90894a412b741d39` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.203406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] RBAC: Authorizing `identity:get_user(user_id=d7917245cbef4b4b90894a412b741d39)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.205348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.207446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 58/126] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/users/d7917245cbef4b4b90894a412b741d39 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.212806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.244709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b72ad-a4eb-4a62-8b08-0004b2d910d6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.280547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.281382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.281656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.282160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.293443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:37.301611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:37.302580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:37.303391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 69/127] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:37.308500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.334628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f0aa-1e8e-4833-b7c3-c20ebec0a62e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.369881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.370940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.371328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.371734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.373269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.374739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.381311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 59/128] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.382303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.429816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548966cd-76fe-41fd-8442-2a67ea15257f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.464554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.465477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.465917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.466391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.494928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfba-cabf-4538-be26-275ae1025b76 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.530008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.530839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.531223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.531596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.532496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:37.532910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.534448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.536657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.538357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.544088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 60/129] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.544860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.637779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 70/130] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:37.639015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.652502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3222d6-c312-421a-97ea-d1de3b775f4f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.687864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.688989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.689306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.689690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.691053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.692890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.694513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 61/131] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.695374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.781454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960480b-054a-424a-b776-b4d90a8c7b7a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.801661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af504ef3-822d-454f-a0e4-9700c82dfa0f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.817283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.818617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.819071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.819482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.820913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.822569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.824818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 71/132] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.825805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.843528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.844581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.844933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.845274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.846743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.848198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.850417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 62/133] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:37.850866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:37.929625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff4d-e73b-40fd-ac3b-2e53a46b1a26 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.955943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fef66-650e-443d-91bb-fbc90780ff33 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:37.964475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.965726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.966227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.966733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/users/e2fff94fab47494ebebc775758ec7bee/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.968985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, user_id=e2fff94fab47494ebebc775758ec7bee, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:37.970687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:37.992199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:37.993178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:37.993488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:37.998945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] PATH_INFO: `/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:37.999030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 72/134] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:37 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/users/e2fff94fab47494ebebc775758ec7bee/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:37.999639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] RBAC: Authorizing `identity:get_project(project_id=90a1d96dbfda4f89bf76c48aafa855ee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:38.008591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:38.010675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:38.012521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 63/135] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:38.036949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:38.222327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ecf0-7be9-4929-8c2f-46d89aabe252 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:38.228547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2953-4118-4259-a849-01eb930ca36e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:38.273164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:38.274092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:38.274389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:38.274740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] PATH_INFO: `/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:38.275417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:38.276518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:38.276855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=90a1d96dbfda4f89bf76c48aafa855ee, user_id=3bd206864bcc414c9408f8a1f6b0e30e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:38.277209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:38.277671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:38.278717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e31d74-a951-4e08-b517-13786f303ac0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:38.279309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=d7917245cbef4b4b90894a412b741d39) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:38.279861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:38.281593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f46d-5f69-4cd5-9026-5ff0baad1754 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:38.299087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 73/136] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:37 2022] GET /identity/v3/role_assignments?user.id=d7917245cbef4b4b90894a412b741d39&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=f908b1928f2d46a4b576ec457219471d => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:38.300230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 64/137] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:38 2022] PUT /identity/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee/users/3bd206864bcc414c9408f8a1f6b0e30e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:39.494145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f985c80-17fa-42e9-9c16-19bf930708d3 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.494686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f985c80-17fa-42e9-9c16-19bf930708d3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.494686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f985c80-17fa-42e9-9c16-19bf930708d3 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.496459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 74/138] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:39.501871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.502373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.502448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.522869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:39.524111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:39.594838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 65/139] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:39.621241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f985c80-17fa-42e9-9c16-19bf930708d3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:39.733986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f985c80-17fa-42e9-9c16-19bf930708d3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:39.773988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:39.774812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.775097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.775377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.776584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:39.778051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49c7d0-4e71-444c-9157-69b7a4881ce9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:39.780389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 75/140] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:39.786118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:39.890674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00644fa5-8547-4e8a-96b4-b77d0a7e16f8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:39.892456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22f4-1264-421e-8806-8d648665b267 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.892754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22f4-1264-421e-8806-8d648665b267 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.893023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22f4-1264-421e-8806-8d648665b267 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.894506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 76/141] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:39.899544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.899951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.900239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.928893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:39.930498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:39.954899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:39.954899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:39.954899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:39.954899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:39.955316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:39.955316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:40.003272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 66/142] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:39 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:40.070529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 77/143] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:40.105968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:40.255886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c19e-7b9b-45ce-8acb-18f2c2f16734 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:40.296293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:40.297147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.297432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.297820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:40.316754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:40.324899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:40.325835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:40.327056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 67/144] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:40.336899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:40.523836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7be8b-5c49-4319-a2c7-237ba064ef65 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:40.570231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:40.570942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.571228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.571507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:40.572310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:40.572620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:40.574044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:40.588333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 78/145] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:40.594331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:40.723371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e878d-430a-4652-8ff6-83791993e8bb None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:40.756842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:40.757739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.758024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.758301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:40.759547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:40.761095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800a11-62e0-4d8d-a26d-72ab6518b138 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:40.763066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 68/146] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:40 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:40.768650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:40.835743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe080-0128-4e79-98e3-19eb1a44ee4b None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.835916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe080-0128-4e79-98e3-19eb1a44ee4b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.836191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe080-0128-4e79-98e3-19eb1a44ee4b None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:40.837814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 69/147] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:40.842762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.843082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.843327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:40.861007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:40.862224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:40.907628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e8e9-08f2-4ee6-a7ef-776b2a0d0a9c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:40.957315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 70/148] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:40.971257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:40.971963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:40.972350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:40.972633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.039756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.076875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.078383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.181716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0421e8-4987-4784-abfe-ad2f9dcc907f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.222144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.223715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.223715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.223715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.239207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:41.253989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:41.254980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:41.255798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 71/149] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:41.261575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.280501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 79/150] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:41.299904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.371043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d011d-ec60-4ae7-aabc-7d877845ac4d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.405667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.406351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.406638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.406915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.407703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:41.408158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.409653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.418981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 72/151] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:41.425070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.458154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32361c9-5862-476d-b6d7-4b772680de5b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.528807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.529714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.530008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.530276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.531543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.532587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41850e63-e123-4c9f-8ca8-e9d7188c34a8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.533028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.535004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 80/152] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:41.541043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.568300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.569259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.569543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.569818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.571138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.572726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a05c58-5159-499e-a5ed-96a688d9321a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.574389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 73/153] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:41.575651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b095-41ea-4179-9ec4-8fb16dbbf271 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.580154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b095-41ea-4179-9ec4-8fb16dbbf271 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.580449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b095-41ea-4179-9ec4-8fb16dbbf271 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.582264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 74/154] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:41.583783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2b095-41ea-4179-9ec4-8fb16dbbf271 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:41.728350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3b4e-c2c8-4244-ae71-16b0f7b60016 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.748373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2b095-41ea-4179-9ec4-8fb16dbbf271 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:41.784511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.785249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.785538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.785817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.788477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:41.789165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.789445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.789717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.790571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:41.791019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.792560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d57bc-4655-49d2-9f44-bd459dcd704f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.799462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 81/155] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:41.800876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f585e7-96a9-441a-a776-9c7215cfd2c5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.801166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f585e7-96a9-441a-a776-9c7215cfd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.801441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f585e7-96a9-441a-a776-9c7215cfd2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.828912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d0f585e7-96a9-441a-a776-9c7215cfd2c5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:41.830132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d0f585e7-96a9-441a-a776-9c7215cfd2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:41.868842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:41.870388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e137871-2084-4ede-8be3-db9f10670cfd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:41.934629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 82/156] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:41.936183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd1c4-691a-4e36-a0a0-fad06bc92998 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.936479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd1c4-691a-4e36-a0a0-fad06bc92998 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.936752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd1c4-691a-4e36-a0a0-fad06bc92998 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.938161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 83/157] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:41.945852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:41.946230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:41.946578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:41.969070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:41.970423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:42.048759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 84/158] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:42.056705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.070773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 75/159] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:35:42.072177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b43-b043-47a5-9897-418414cd29d0 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.072465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b43-b043-47a5-9897-418414cd29d0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.072735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b43-b043-47a5-9897-418414cd29d0 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.074007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 76/160] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:42.077213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3b43-b043-47a5-9897-418414cd29d0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.227404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dd68a-9180-4054-81a6-be1ada9a790a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.273500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.274551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.274831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.275102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.284467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3b43-b043-47a5-9897-418414cd29d0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.287969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-9b3f277b-0abf-49c7-8e14-d04daa2dd68d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:42.297719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:42.298662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:42.299500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 85/161] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:42.300959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.301340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.301708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.328763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:42.330133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:42.353755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.355658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.356839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.357364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.359680 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:42.361862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:42.368613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 77/162] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:42.369654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.443002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 86/163] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:42.444220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.545596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863320-cb40-4b8d-baf8-f9c6ddddd135 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.583526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.584298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.584578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.584847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.601738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:42.612821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:42.613883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:42.614672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:42.619441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 78/164] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:42.620652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.629184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0f722-e1a3-4758-a05d-ee5d1a31caae None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.697953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.698629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.698908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.699181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.699971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:42.700275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:42.701691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:42.718961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 87/165] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:42.721256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.805689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110beccf-1eae-4b61-9c61-e309ac17f66c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.872060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.873065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.876290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.876792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.877864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:42.878420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:42.880147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:42.889491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 79/166] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=81b7812443324595b557a25ca9559d8d => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:42.891298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:42.906763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ff124-0b56-47ee-94a0-52a2cace666b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:42.956563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:42.957763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:42.958243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:42.958771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:42.971632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:42.980881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:42.981832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:42.982650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:42.985360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 88/167] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:42.986618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.101959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6cd7-834c-4f48-af57-0d0afde056e9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.139243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.140706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.141186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.141799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] PATH_INFO: `/v3/users/e2fff94fab47494ebebc775758ec7bee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.143373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] RBAC: Authorizing `identity:get_user(user_id=e2fff94fab47494ebebc775758ec7bee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.145581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.147437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 89/168] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/users/e2fff94fab47494ebebc775758ec7bee => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.149010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.182724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f88a-daef-43dc-ad57-5779a7b55588 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.263059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86846584-37a3-4319-80db-2e1dcba8097a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.276422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.277136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.277414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.277686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.278834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:43.279146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.280624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.302091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 80/169] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.303011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.303604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.304576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.305069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.305527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.306639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:43.307299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.309546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.321300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 90/170] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.322683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.429869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93e00-f2cd-4175-810c-ace47f2a93d2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.463812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.464707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.464986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.465264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] PATH_INFO: `/v3/users/3bd206864bcc414c9408f8a1f6b0e30e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.466476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] RBAC: Authorizing `identity:get_user(user_id=3bd206864bcc414c9408f8a1f6b0e30e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.467973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.469800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 91/171] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/users/3bd206864bcc414c9408f8a1f6b0e30e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.470300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a3fa-47b2-4752-b0e6-60d35b5445e8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.470497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.523543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.524244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.524531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.524805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.575108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf0c4-7eb6-492d-8c38-2ef88d77b1ad None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.609105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.610316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.610735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.611304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] PATH_INFO: `/v3/users/d7917245cbef4b4b90894a412b741d39` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.612814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] RBAC: Authorizing `identity:get_user(user_id=d7917245cbef4b4b90894a412b741d39)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.614464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.616330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 92/172] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/users/d7917245cbef4b4b90894a412b741d39 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.617448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.656960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.658574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.724511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251876-bb51-4e2a-b9d9-383f06683f5a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.758838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.759938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.760436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.760900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.777616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 81/173] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:43.779065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.830824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.832690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.878378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c921-36c6-4d59-8afa-9a73e0b3ac31 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:43.912572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431968-027f-48e8-a280-cd975395b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:43.913678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431968-027f-48e8-a280-cd975395b749 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:43.914102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431968-027f-48e8-a280-cd975395b749 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:43.914543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431968-027f-48e8-a280-cd975395b749 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:43.915887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39431968-027f-48e8-a280-cd975395b749 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:43.917526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39431968-027f-48e8-a280-cd975395b749 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:43.919446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 82/174] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:43.920410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431968-027f-48e8-a280-cd975395b749 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:43.933795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 93/175] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:43.934996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.059146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224dea-2cd0-4693-809d-65369bed3739 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.064269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431968-027f-48e8-a280-cd975395b749 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.093610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.094791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.095210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.095612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/users/d7917245cbef4b4b90894a412b741d39/roles/f908b1928f2d46a4b576ec457219471d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.097897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, user_id=d7917245cbef4b4b90894a412b741d39, role_id=f908b1928f2d46a4b576ec457219471d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:44.099512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6df07-ee7f-4246-8b0d-a9874ef9612a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:44.106695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.107647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.108055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.108376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.109746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:44.111438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:44.118094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 83/176] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:43 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:44.118094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.118281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 94/177] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:43 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/users/d7917245cbef4b4b90894a412b741d39/roles/f908b1928f2d46a4b576ec457219471d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:44.119981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e77b96-f7d9-42e8-b550-8948de9ab4a5 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.119981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e77b96-f7d9-42e8-b550-8948de9ab4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.119981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e77b96-f7d9-42e8-b550-8948de9ab4a5 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.121241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 95/178] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:44.122048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e77b96-f7d9-42e8-b550-8948de9ab4a5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.325801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e77b96-f7d9-42e8-b550-8948de9ab4a5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.330156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab6e0-a87b-417d-8e05-e78050ec71bb None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.373860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.374530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.374808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.375078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.376494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=e2fff94fab47494ebebc775758ec7bee) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:44.377009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:44.378792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a566-7537-4bf8-abe7-c9eddacd984b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:44.388771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 96/179] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:44 2022] GET /identity/v3/role_assignments?user.id=e2fff94fab47494ebebc775758ec7bee&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:44.390057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.390347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.390624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.398004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.399258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.399779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.400470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] PATH_INFO: `/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.402854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] RBAC: Authorizing `identity:get_project(project_id=90a1d96dbfda4f89bf76c48aafa855ee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:44.410219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:44.412511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 84/180] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:44 2022] GET /identity/v3/projects/90a1d96dbfda4f89bf76c48aafa855ee => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:44.416985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:44.418419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:44.419016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.568273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 97/181] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:44.602627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef95bd-9437-4e34-b332-8b2d7f9cab94 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.656318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.657331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.657796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.658274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.659322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=90a1d96dbfda4f89bf76c48aafa855ee, user.id=3bd206864bcc414c9408f8a1f6b0e30e) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:44.660064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:44.661738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:44.668957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 85/182] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:44 2022] GET /identity/v3/role_assignments?user.id=3bd206864bcc414c9408f8a1f6b0e30e&scope.project.id=90a1d96dbfda4f89bf76c48aafa855ee&role.id=81b7812443324595b557a25ca9559d8d => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:44.672420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.789280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698fed6-c561-44b4-8cdf-7d2a88ec72be None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:44.824966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:44.826139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.826630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.827087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.838657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-28a4c48a-bcd4-41ba-a784-35976769da35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:44.846590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:44.847594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:44.848444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:44.850921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 98/183] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:44.858352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:44.872087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27b31-512b-44a7-ae67-304f2105b1aa None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.872744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27b31-512b-44a7-ae67-304f2105b1aa None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.874885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27b31-512b-44a7-ae67-304f2105b1aa None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.876572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 99/184] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:44.883323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a20eb-d77f-49be-b497-c71aa22693de None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:44.884000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a20eb-d77f-49be-b497-c71aa22693de None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:44.884485 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a20eb-d77f-49be-b497-c71aa22693de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:44.920380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-667a20eb-d77f-49be-b497-c71aa22693de None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:44.922636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-667a20eb-d77f-49be-b497-c71aa22693de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:45.006435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5b38-780b-4d9f-8cc8-8c1fca4ce243 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.010569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 100/185] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:45.012500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ad53-3688-4849-9f53-ac34f2b5314a None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.012993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ad53-3688-4849-9f53-ac34f2b5314a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.013461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ad53-3688-4849-9f53-ac34f2b5314a None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.015369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 101/186] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:45.025262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.025837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.026169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.042493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.043194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.043467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.043758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.044508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:45.044806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.046214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.050284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:45.051504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:45.055153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 86/187] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.056224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.138374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 102/188] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:45.148616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.165543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd8643-6bb6-4c39-922f-ee77d7548843 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.200021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.200846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.201124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.201395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.213013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:45.221087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:45.222031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:45.222901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:45.227252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 87/189] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:45.228060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.255438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd282b4-8665-43a1-b456-54fde904666d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.290974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.291919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.292199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.292473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.305415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.306898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.308620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 103/190] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.309391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.342271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bc14a-a952-4b01-8839-e32bf169a863 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.383260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.384117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.384837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.385114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.386709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.388938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.395543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 88/191] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.395543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.409690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243648c-3ab3-42a7-99a5-598eb130a480 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.443683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.444394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.444670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.444938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.445688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:45.445993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.447403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.455570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 104/192] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.456217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.502456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2e5ac-e2f7-443a-88d9-348586c7f3b7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.535125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.535821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.536106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.536377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.554595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926df6-7a34-4656-af28-2e1bdbd70f40 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.587873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.588839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.589118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.589394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.590100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.591549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.602051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.603590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.619701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 105/193] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:45 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:45.620836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.711354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 89/194] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:45.720860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.729471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346efb-b7de-4546-84c5-f834bbbaaa1e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.767359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.768741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.769247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.769746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.771476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.773457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.775797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 106/195] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.786866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.828203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa44d-84e5-4107-ac06-1737ae371a8f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.865616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.866507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.866786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.867055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.868302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:45.869789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:45.871762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 90/196] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:45.880179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:45.893217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c681d-a93c-4606-bacc-45d660aef340 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:45.930528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:45.931253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:45.931546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:45.931860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:45.988944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71885e-9c56-4fe7-8945-07bbd1ba2e69 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:46.007615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:46.009565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:46.037045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:46.037722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:46.037983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:46.038252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:46.039096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=38eb42bf9c86437e8d9766bd4a11738b) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:46.039403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:46.040940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:46.047849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 91/197] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/role_assignments?user.id=38eb42bf9c86437e8d9766bd4a11738b&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:46.131645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 107/198] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:46.135583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:46.244209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66d62-901b-4895-8448-a5da7029f8de None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:46.283083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:46.284004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:46.284284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:46.284636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:46.288369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:46.289859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ec14-27c2-4cfe-b159-192eb7612f0d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:46.291590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 92/199] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:46 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:46.297717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:46.420164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadcbe1-b8e5-4406-bb84-15246e6c1e54 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:46.452777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:46.453454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:46.453748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:46.454020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:46.454936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=38eb42bf9c86437e8d9766bd4a11738b) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:46.455255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:46.456798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153bcf-6cae-4e8a-8ad7-bef60abcb558 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:46.466747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 108/200] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:46 2022] GET /identity/v3/role_assignments?user.id=38eb42bf9c86437e8d9766bd4a11738b&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:46.720286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e19c9-d02f-45d9-a5e8-55622867bb83 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:46.720702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e19c9-d02f-45d9-a5e8-55622867bb83 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:46.720882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e19c9-d02f-45d9-a5e8-55622867bb83 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:46.722666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 93/201] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:46.737447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:46.737885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:46.738155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:46.765101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:46.766591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:46.844422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 109/202] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:46.867777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e19c9-d02f-45d9-a5e8-55622867bb83 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:46.981017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e19c9-d02f-45d9-a5e8-55622867bb83 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:47.020894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:47.021695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:47.021969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:47.022238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:47.033051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:47.040742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:47.043556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:47.045435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 94/203] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:47.051699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:47.150199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897d9a-3bb3-423e-a3ef-154ab80e2686 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:47.190074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:47.190846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:47.191130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:47.191401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:47.192195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] RBAC: Adding query filter params (name=reader) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:47.192497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:47.193956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:47.202844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 110/204] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:47.209296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:47.353094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de2e95-e300-419d-9fa3-40b869d6fdb4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:47.385987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:47.386881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:47.387150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:47.387418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] PATH_INFO: `/v3/users/d7917245cbef4b4b90894a412b741d39` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:47.388630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] RBAC: Authorizing `identity:get_user(user_id=d7917245cbef4b4b90894a412b741d39)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:47.390222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:47.392298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 95/205] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:47 2022] GET /identity/v3/users/d7917245cbef4b4b90894a412b741d39 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:47.398189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:47.515677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85fdcb-69de-48fc-8333-c386e6c422de None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:47.561859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:47.562527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:47.562814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:47.563085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:47.669110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:47.670614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:47.791907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 111/206] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:47.800923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:47.911226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2f5d-58a5-430d-bdac-d4986a3f0464 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:47.955838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:47.956692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:47.956969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:47.957237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:47.967952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:47.967952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd68eb-6039-45f1-9885-b781391a6f9b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:47.967952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 96/207] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:47 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:47.973837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:48.074341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6efa-2df6-49af-9cfb-fb9a31f6ee08 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:48.108467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:48.109125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.109399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.109663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.110485 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, scope.project.id=b5e654524ec240dbbf199ca97920650a, user.id=d7917245cbef4b4b90894a412b741d39) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:48.110788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:48.112260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10960d-c2fc-47b2-8ebe-f9d21cbdfcc6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:48.118402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 112/208] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:47 2022] GET /identity/v3/role_assignments?user.id=d7917245cbef4b4b90894a412b741d39&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=f908b1928f2d46a4b576ec457219471d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:48.625601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b138b-1e00-490c-989f-dcbe3eb3f120 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.626097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b138b-1e00-490c-989f-dcbe3eb3f120 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.626097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b138b-1e00-490c-989f-dcbe3eb3f120 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.627639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 97/209] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:48.636209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.636209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.636209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.654247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:48.655599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:48.703066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca2fd2-e304-4316-aa29-425d954ddba4 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.703417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca2fd2-e304-4316-aa29-425d954ddba4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.703589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca2fd2-e304-4316-aa29-425d954ddba4 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.705210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 98/210] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:48.715840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.716142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.716407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.735266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 113/211] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:48.745052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:48.746273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:48.766814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:48.823731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 99/212] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:48.847532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:48.890063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e08ab-2df6-4c5f-bfee-f24d8d9d8f17 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:48.925434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:48.926610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:48.927083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:48.927626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:48.938197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:48.946442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:48.947360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:48.948190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:48.950545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 114/213] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:48.957482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:48.961696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b384a-d857-4e8e-9533-cc438ea25b99 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.001905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.003050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.003555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.004041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.005871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.008013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.010869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 100/214] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:49.016347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.064824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c6929-9f94-4925-9dd9-d82b99907d11 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.097272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.097934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.098199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.098462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.099207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:49.099505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.100918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f735-0e73-4341-ab71-d23d31cfefe7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.109852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 115/215] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:49.114720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee371-9f93-4e7f-8981-bda753e44c0c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.114720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee371-9f93-4e7f-8981-bda753e44c0c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.114720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee371-9f93-4e7f-8981-bda753e44c0c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.114720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 116/216] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:49.117579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee371-9f93-4e7f-8981-bda753e44c0c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.131896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828327ec-f198-4c37-b121-29da24251a5d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.168197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.168893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.169170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.169440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.170255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.171933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48013adf-b4e3-4aeb-9ef2-4953d8c98e3e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.194017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 101/217] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:49 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:35:49.195485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.196191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.196469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.219755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:49.221053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:49.237195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee371-9f93-4e7f-8981-bda753e44c0c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.282945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.284581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.285016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.285669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] PATH_INFO: `/v3/users/9fc9ce06a38641cfb084ed3b756b44a0` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.306338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] RBAC: Authorizing `identity:get_user(user_id=9fc9ce06a38641cfb084ed3b756b44a0)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.308175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.309305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 102/218] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:49.310341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 117/219] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/users/9fc9ce06a38641cfb084ed3b756b44a0 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:49.316371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.343188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.438144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8508e-b81e-411e-b919-d30961d193a4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.451914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304d98-6b39-4732-be71-7de24f97dd0b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.476711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.477643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.478024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.480354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.491257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.492237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.492518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.492902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.506636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c5c2eda9-4578-47a3-9a92-e59f8e2cc022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:49.514883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:49.515855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:49.516704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:49.517320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 118/220] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:49.520778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001b585-66cb-4d4d-91d3-945e9438cd84 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.520778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001b585-66cb-4d4d-91d3-945e9438cd84 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.520778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001b585-66cb-4d4d-91d3-945e9438cd84 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.520778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 119/221] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:49.524048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001b585-66cb-4d4d-91d3-945e9438cd84 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.563307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.564866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d04c2-91f0-4d8a-b1d5-1a15dfdeb2ca None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.647194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001b585-66cb-4d4d-91d3-945e9438cd84 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.686371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 103/222] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:35:49.687648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.687847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.688070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.688397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.689313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.689925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.690394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.691436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:49.692192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.694115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.704099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 120/223] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:49.710088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:49.710088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:49.710932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.784916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 104/224] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:49.785843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.811494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4a8e-ad07-45ff-b5a4-57463c3c82f9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.844998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.846207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.846704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.847224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.848638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.850282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.852216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 121/225] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:49.853169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.884066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9d4e-9be7-452e-beb1-415c2aaf7a3e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.918134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.919046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.919712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.919712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:49.920904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:49.922529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:49.924427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 105/226] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:49.925365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:49.955210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667761c4-a99e-47e8-a8ea-81df4abee51a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:49.988645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:49.989815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:49.990294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:49.990760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.001187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:50.009578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:50.010491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:50.011319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:50.013712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 122/227] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:50.014692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.023022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfda-7535-4871-bbc3-98f12ff022e7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.056831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.057518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.057742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.058008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.058905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=9fc9ce06a38641cfb084ed3b756b44a0) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:50.059214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.061535 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.068881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 106/228] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:49 2022] GET /identity/v3/role_assignments?user.id=9fc9ce06a38641cfb084ed3b756b44a0&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=81b7812443324595b557a25ca9559d8d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:50.069919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.120715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d95ae-bb57-487b-8b50-3a0982ec44af None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.157337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.158597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.159076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.159616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.161139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.162840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.165365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 123/229] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:50 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:50.176775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.258665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc41b7-e44f-4857-81fa-d347ea13a5fb None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.338214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.339183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.339711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.340190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.341174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:50.341685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.343334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.353274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 107/230] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:50.360722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.373842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de1189-bf24-4014-9eb1-933cc09b6632 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.409200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.410556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.411035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.411498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/38eb42bf9c86437e8d9766bd4a11738b/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.413799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, user_id=38eb42bf9c86437e8d9766bd4a11738b, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.415499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.433218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 124/231] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:50 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/38eb42bf9c86437e8d9766bd4a11738b/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:50.483028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c6be-e695-40af-bf20-c7a4499ea526 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.535990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.536822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.537102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.537372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.538816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.540379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.542538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 108/232] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:50 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:50.549688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.694105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8075c-b2e3-4b98-8ac7-eb0ec218fda3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.754492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.755370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.755649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.755978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.757802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.759269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eb8c4-34ce-4a24-a447-2f5070872772 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:50.761031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 125/233] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:50 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:50.768058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:50.915336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50246b9-4d73-4fab-9d5c-479e9b5b5580 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:50.981676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:50.982582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:50.982861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:50.983136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/38eb42bf9c86437e8d9766bd4a11738b/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:50.989402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, user_id=38eb42bf9c86437e8d9766bd4a11738b, role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:50.991119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dff3b-f0f1-4de5-bb19-ad344b10440f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:51.011518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 109/234] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:50 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/38eb42bf9c86437e8d9766bd4a11738b/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:51.984233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772cec-beea-4789-9c4a-284e948cc53c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:51.984749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772cec-beea-4789-9c4a-284e948cc53c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:51.984749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772cec-beea-4789-9c4a-284e948cc53c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:51.986530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 126/235] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:52.001277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41f2f-8be0-4108-9eeb-1d0fe0552dd7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.001770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41f2f-8be0-4108-9eeb-1d0fe0552dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.001845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41f2f-8be0-4108-9eeb-1d0fe0552dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.019464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ddb41f2f-8be0-4108-9eeb-1d0fe0552dd7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:52.020733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ddb41f2f-8be0-4108-9eeb-1d0fe0552dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:52.125163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 110/236] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:52.161695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772cec-beea-4789-9c4a-284e948cc53c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:52.271951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60504-8ceb-4279-b93d-b7da3b3024de None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.272566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60504-8ceb-4279-b93d-b7da3b3024de None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.273035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60504-8ceb-4279-b93d-b7da3b3024de None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.274645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 111/237] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:52.280372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.280876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.281348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.309285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:52.310490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:52.313107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772cec-beea-4789-9c4a-284e948cc53c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:52.381557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:52.382380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.382658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.383094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.384331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:52.386150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:52.388391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 127/238] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:52.394250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:52.438134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 112/239] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:52.486004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:52.571591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b0d5-924b-489a-afef-84b4561498eb None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:52.620314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31828-f166-4f06-a517-fc75da87e947 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:52.650144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:52.651141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.651719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.652132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.652995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:52.654951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:52.687596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 128/240] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:52 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:52.688392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:52.689213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.689564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.689894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.710919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:52.719098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:52.720237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:52.721042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 113/241] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:52.726844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:52.869227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22b6b-34bb-446d-8877-9a367e51a256 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:52.912589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:52.913289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:52.913563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:52.913831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:52.914592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:52.914892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:52.916348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c598c0-1ac2-45fd-98c6-5ec9858dadf1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:52.925814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 129/242] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:52.931538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.045307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d895d-a208-4935-8f11-33fc6c3b8205 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.084180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.085099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.085375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.085651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] PATH_INFO: `/v3/users/1bfa06092b5946999e92e36ca3d4c7e6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.103385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfa06092b5946999e92e36ca3d4c7e6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:53.105370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:53.107878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 114/243] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:52 2022] GET /identity/v3/users/1bfa06092b5946999e92e36ca3d4c7e6 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:53.113363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.113563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f84b-950f-455d-8667-db78bb675af3 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.113983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f84b-950f-455d-8667-db78bb675af3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.113983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f84b-950f-455d-8667-db78bb675af3 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.115529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 130/244] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:53.122385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.122637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.122870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.143231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:53.144481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:53.235214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37dd08-15d3-4e5e-a82a-00bed06b9c56 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.235407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 131/245] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:53.266778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.287831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.288860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.289331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.289812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.366377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:53.368410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2063a-9658-4660-aea3-241c9fdeccd9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:53.399081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35148-0ca3-4f54-a579-51ac01492aa4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.449510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.451251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.451978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.452393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.465684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b2ff097f-51e9-4037-b8fa-11c03a08f21d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:53.474708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:53.475890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:53.476939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:53.480444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 132/246] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:53.482842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878767e-17d5-43a3-96bd-f6bd949d8af2 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.483361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878767e-17d5-43a3-96bd-f6bd949d8af2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.483844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878767e-17d5-43a3-96bd-f6bd949d8af2 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.485611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 133/247] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:53.487335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878767e-17d5-43a3-96bd-f6bd949d8af2 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.506004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 115/248] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:53.507656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.508085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.508460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.526217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:53.527579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:53.626832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 116/249] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:53.628042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.681409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878767e-17d5-43a3-96bd-f6bd949d8af2 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.742513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d342e-b577-4bb7-8901-9e231f97ae21 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.773342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.774028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.774536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.774536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.775399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:53.775638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:53.777173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:53.786346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.787477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.788136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.788564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.790851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:53.794269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51358c-0697-4c25-99b4-0124e27b50c5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:53.796278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 117/250] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:53.796939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 134/251] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:53.797950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.800414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c566-7de4-4001-9c0f-9489ceb1494c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.800851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c566-7de4-4001-9c0f-9489ceb1494c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.801283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c566-7de4-4001-9c0f-9489ceb1494c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.804179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 118/252] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:53.805160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c566-7de4-4001-9c0f-9489ceb1494c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.910515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0863-72d1-4b80-bc66-fe312eeecd56 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.921566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c566-7de4-4001-9c0f-9489ceb1494c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:53.953109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.954132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.954559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.955250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.955586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:53.956686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.957060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.957425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] PATH_INFO: `/v3/users/9fc9ce06a38641cfb084ed3b756b44a0` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:53.958730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] RBAC: Authorizing `identity:get_user(user_id=9fc9ce06a38641cfb084ed3b756b44a0)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:53.960405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:53.962558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 119/253] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/users/9fc9ce06a38641cfb084ed3b756b44a0 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:53.963568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:53.968571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b4814146-35df-4643-8d5e-11183c6f4552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:53.976584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:53.977475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:53.978315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 135/254] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:53.979042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:53.979108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:53.979699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.001785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:54.002917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:54.071560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 136/255] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:54.080610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.090514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed92fc-713e-4156-8d05-de4463b4093a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.130473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.132334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.132334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.132505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.133251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=1bfa06092b5946999e92e36ca3d4c7e6) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:54.133553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.135040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.140733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 120/256] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:53 2022] GET /identity/v3/role_assignments?user.id=1bfa06092b5946999e92e36ca3d4c7e6&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=f908b1928f2d46a4b576ec457219471d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:54.141607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.222556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45fbdf-47dc-4719-af22-d30da2073dec None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.246631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c17c9-3557-4153-9adf-23f53fa575ae None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.270756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.272684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.273224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.273953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.276295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.278937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.281666 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 137/257] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:54.286601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.289503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.290416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.290862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.291348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.292376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:54.292845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.294440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.304169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 121/258] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:54.305329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.396804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fe13-0267-4a54-a5f0-a95590c5bcd6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.438253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2cb0-a5c3-4779-b0dc-8f84b8c3e3d4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.479409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.480710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.481211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.481691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/9fc9ce06a38641cfb084ed3b756b44a0/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.484133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, user_id=9fc9ce06a38641cfb084ed3b756b44a0, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.485916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.498266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.499226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.499553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.504019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.505890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 122/259] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:54 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/9fc9ce06a38641cfb084ed3b756b44a0/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:35:54.506998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.521912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:54.538744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:54.539797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:54.540632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 138/260] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:54.546438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.623105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21bf6-3c79-4323-9cf9-4207e4932576 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.664886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.666918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.667575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.668120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.670373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.672296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.674312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 123/261] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:54.697529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.711923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c18f9-b4e8-48a8-9cf8-40618e702e70 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.747658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.748317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.748597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.748873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.749639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:54.749942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.751353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.760321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 139/262] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:54.765998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.809569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408f24d-e2a3-4792-9178-511c1de41207 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.845888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.847026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.847508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.847997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.870256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087285cc-c2b6-4f73-8130-9aa12bd7545f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:54.905421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:54.906309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:54.906590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:54.906878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] PATH_INFO: `/v3/users/38eb42bf9c86437e8d9766bd4a11738b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:54.908127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] RBAC: Authorizing `identity:get_user(user_id=38eb42bf9c86437e8d9766bd4a11738b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.909738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:54.915785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 140/263] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/users/38eb42bf9c86437e8d9766bd4a11738b => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:54.917178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:54.922706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:54.924492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.019226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e93b-9365-4e9f-b2b7-7c44706e49d7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:55.032666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 124/264] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:55.039945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:55.060472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:55.061400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:55.061828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:55.062236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:55.156122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16b592-a780-4dcf-a977-681470f1a6b9 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:55.176613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:55.178102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.197895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:55.199179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:55.199702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:55.200167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:55.203179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:55.204963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.209367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 125/265] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:55 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:55.213887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:55.360296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 141/266] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:35:55.370678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:55.397148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d019e-4b0b-433c-9ffb-10d4e837f39c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:55.479548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c794-10cb-4683-94d1-68ecd18e6456 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:55.480387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:55.481078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:55.481366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:55.481646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:55.482501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=38eb42bf9c86437e8d9766bd4a11738b) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:55.482814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:55.487686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.496971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 126/267] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:55 2022] GET /identity/v3/role_assignments?user.id=38eb42bf9c86437e8d9766bd4a11738b&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:55.534605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:55.535634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:55.535942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:55.536233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:55.540626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:55.542148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab825-02ec-46ce-ab73-c5ed43bf43f6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.544321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 142/268] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:55 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:55.550817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:55.670582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c815d0e-93d1-44cb-939d-a701df290663 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:55.714962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:55.715653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:55.715956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:55.716235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:55.717143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=38eb42bf9c86437e8d9766bd4a11738b) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:55.717451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:55.719079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b79b-c5d8-43b9-8f1a-c19a739f64d0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:55.728967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 127/269] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:55 2022] GET /identity/v3/role_assignments?user.id=38eb42bf9c86437e8d9766bd4a11738b&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:56.112922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ddde-58cc-4893-979f-5ac6b9b1d3dd None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.113101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ddde-58cc-4893-979f-5ac6b9b1d3dd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.113454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ddde-58cc-4893-979f-5ac6b9b1d3dd None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.114844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 143/270] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:56.126880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3cc3-15ab-48b8-8d40-9a53b302a4fb None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.127205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3cc3-15ab-48b8-8d40-9a53b302a4fb None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.127454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3cc3-15ab-48b8-8d40-9a53b302a4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.147232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-538d3cc3-15ab-48b8-8d40-9a53b302a4fb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:56.148477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-538d3cc3-15ab-48b8-8d40-9a53b302a4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:56.227159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 128/271] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:56.252284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72ddde-58cc-4893-979f-5ac6b9b1d3dd None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:56.338933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe385f-3daf-4e7c-8f9d-7763c1f1d042 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.339461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe385f-3daf-4e7c-8f9d-7763c1f1d042 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.339951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe385f-3daf-4e7c-8f9d-7763c1f1d042 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.341939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 129/272] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:56.347238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.347826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.348314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.366868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:56.368427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:56.375435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72ddde-58cc-4893-979f-5ac6b9b1d3dd None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:56.414084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:56.414901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.415232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.415508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.416819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:56.418305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:56.420039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 144/273] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:56.425600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:56.447977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 130/274] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:35:56.472840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:56.556157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821971-9d62-4b5e-8600-a9067862a75c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:56.584142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f7ed3-a841-4249-9b44-de0e50a1da03 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:56.597507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:56.598357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.598641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.598916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.600016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:56.601521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:56.632100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:56.632309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 145/275] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:35:56 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:35:56.632392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.632392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.632392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.644401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:56.653536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:56.654684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:56.655541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:56.657966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 131/276] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:56.665883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:56.790737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca376fb-e5bd-4609-808d-8d62e708fbd1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:56.827912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:56.828596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:56.828888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:56.829147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:56.829895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:56.830199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:56.831733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:56.840917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 146/277] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:56.847354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:56.966330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925c68c-a25b-4352-83f0-d8b49ecffb1c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:57.001091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:57.001975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.002249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.002526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] PATH_INFO: `/v3/users/0a11dcc4656e4cbf8124e2dea75561f6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.016637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] RBAC: Authorizing `identity:get_user(user_id=0a11dcc4656e4cbf8124e2dea75561f6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:57.018244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1663ba-5d9e-4767-b170-8f54531579a6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:57.020366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 132/278] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:56 2022] GET /identity/v3/users/0a11dcc4656e4cbf8124e2dea75561f6 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:57.026330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:57.127538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f815c-46ec-4b76-a129-5d1d6993afbe None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:57.163116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:57.163808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.164086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.164357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.165188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, user.id=0a11dcc4656e4cbf8124e2dea75561f6, scope.system=all) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:57.165501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:57.166965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ad32-2485-4394-bc7f-7d91679d3f5f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:57.172650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 147/279] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 14:35:57 2022] GET /identity/v3/role_assignments?user.id=0a11dcc4656e4cbf8124e2dea75561f6&scope.system=all&role.id=81b7812443324595b557a25ca9559d8d => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:57.466311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddfc0b-bf87-4960-a311-b60457ffd175 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.466840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddfc0b-bf87-4960-a311-b60457ffd175 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.466840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddfc0b-bf87-4960-a311-b60457ffd175 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.468558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 133/280] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:57.473906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.474424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.474424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.496667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:57.497881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:57.505411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bf5e8-66ae-4c7a-9227-07801b773895 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.505694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bf5e8-66ae-4c7a-9227-07801b773895 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.505971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bf5e8-66ae-4c7a-9227-07801b773895 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.507480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 134/281] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:57.517525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.517866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.518072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.541521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:57.542715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:57.618570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 135/282] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:57.620234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 148/283] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:57.640714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:57.654259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:57.752761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e40aa-4be5-4a5c-b7fa-c5a7192b5459 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:57.794239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:57.795087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.795366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.795637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.822775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:57.830531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:57.831514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:57.832398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:57.839114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22a0c-2515-4751-bfa4-0905c6bf0721 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:57.840283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 136/284] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:57.847980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:57.882064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:57.882801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:57.883082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:57.883356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:57.895209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:57.903751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:57.904735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:35:57.905563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 149/285] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:35:57.910882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.020495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309db192-cfee-4631-8beb-0e565992f507 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.056198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.056892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.057172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.057444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.058202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:58.058509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.059939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.070490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 150/286] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:58.077356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.082524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399a51-cc90-4fec-a85e-f5781c893169 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.141619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.142318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.142595 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.142861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.143788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:58.144095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.145552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.164173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 137/287] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:35:58.170353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.272016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301b88-b094-4493-9476-1e97699ed957 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.317522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061efdd-dc47-414e-be4d-c66a08046886 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.323754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.323897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.324074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.324354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] PATH_INFO: `/v3/users/9fc9ce06a38641cfb084ed3b756b44a0` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.327378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] RBAC: Authorizing `identity:get_user(user_id=9fc9ce06a38641cfb084ed3b756b44a0)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.327378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.329077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 151/288] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:58 2022] GET /identity/v3/users/9fc9ce06a38641cfb084ed3b756b44a0 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:58.338909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.385378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.386255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.386534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.386803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] PATH_INFO: `/v3/users/1bfa06092b5946999e92e36ca3d4c7e6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.388650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfa06092b5946999e92e36ca3d4c7e6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.390148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.394105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 138/289] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:35:58 2022] GET /identity/v3/users/1bfa06092b5946999e92e36ca3d4c7e6 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:58.400029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.515405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54885b-eb87-432c-9c56-7ebcda70d932 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.519151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d8fac-124f-44ba-8d68-07452ec9e585 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.560469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.561348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.561628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.561899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.564416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.566054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.568198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 139/290] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:58 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:58.573938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:58.599086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.599834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.600119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.602053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.742577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6f19-81e8-46b7-8894-58ebc958b06b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:58.760135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.761625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.782897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:58.783818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:58.784125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:58.784397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/1bfa06092b5946999e92e36ca3d4c7e6/roles/f908b1928f2d46a4b576ec457219471d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:58.788998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, user_id=1bfa06092b5946999e92e36ca3d4c7e6, role_id=f908b1928f2d46a4b576ec457219471d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:58.790485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:58.815769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 140/291] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:35:58 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/users/1bfa06092b5946999e92e36ca3d4c7e6/roles/f908b1928f2d46a4b576ec457219471d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:35:58.894881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 152/292] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:35:58.900532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.039318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3aab4-d30d-4e5e-ae24-a3c262ad88c0 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:59.079195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:59.080172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.080447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.080763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.082015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:59.083543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe629-07f0-41fe-8e52-060a7dfafa91 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:59.085298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 141/293] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:35:58 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:59.091433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.204099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8a06-580b-4d8a-b038-69a1d751368a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:59.237646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:59.238304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.238579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.238846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.239691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=9fc9ce06a38641cfb084ed3b756b44a0) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:35:59.240002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:59.241442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfec47-9812-4d33-bdec-249911665a14 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:59.247407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 153/294] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:35:59 2022] GET /identity/v3/role_assignments?user.id=9fc9ce06a38641cfb084ed3b756b44a0&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=81b7812443324595b557a25ca9559d8d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:59.478481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ca7-be3c-49ae-b413-cb8ae550a939 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.478858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ca7-be3c-49ae-b413-cb8ae550a939 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.479058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ca7-be3c-49ae-b413-cb8ae550a939 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.480780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 142/295] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:59.486731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c8dc9-4dae-41f5-841b-d2fb88bd8d92 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.487021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c8dc9-4dae-41f5-841b-d2fb88bd8d92 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.487359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c8dc9-4dae-41f5-841b-d2fb88bd8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.504657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9f5c8dc9-4dae-41f5-841b-d2fb88bd8d92 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:59.505869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9f5c8dc9-4dae-41f5-841b-d2fb88bd8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:59.597038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 154/296] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:59.634171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314ca7-be3c-49ae-b413-cb8ae550a939 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.658610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c3e6-9652-48fb-a205-94b60b9f56ba None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.658950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c3e6-9652-48fb-a205-94b60b9f56ba None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.659217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c3e6-9652-48fb-a205-94b60b9f56ba None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.660969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 155/297] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:35:59.666062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.666346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.666619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.685271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:35:59.686441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:35:59.780062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314ca7-be3c-49ae-b413-cb8ae550a939 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:59.790965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 156/298] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:35:59.824750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.846613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:59.847614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.847873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.848150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.859885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:35:59.868809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:35:59.870910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:35:59.872849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 143/299] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:35:59.881303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.935459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b8abe-c570-4922-bf39-48d354a44f02 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:35:59.969397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:35:59.970218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.970499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.970771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.972087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:35:59.973540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a8a7-5929-466d-a356-577840ced4af None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:35:59.975185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 157/300] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:35:59.976540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc76e4-b240-4ffa-99b8-50bd5fcdf90f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:35:59.976761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc76e4-b240-4ffa-99b8-50bd5fcdf90f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:35:59.977038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc76e4-b240-4ffa-99b8-50bd5fcdf90f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:35:59.979781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 158/301] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:35:59.981585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc76e4-b240-4ffa-99b8-50bd5fcdf90f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:35:59.992061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfb8d0-408b-4a68-adca-3bf21eca38e3 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.024097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.024778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.025052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.025320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.026068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:00.026365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.027788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d465-9e7f-49c6-893b-5fc92a5e65c4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.037355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 144/302] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:00.038649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.038935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.039204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.055853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:00.057032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:00.096628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc76e4-b240-4ffa-99b8-50bd5fcdf90f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.130792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.131373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.131648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.131952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] PATH_INFO: `/v3/groups` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.132645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.143965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 145/303] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:00.143965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.144197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.167583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 159/304] 10.222.0.21 () {60 vars in 1134 bytes} [Wed May 4 14:35:59 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:36:00.168790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.252905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feea76-fb05-44d0-9163-6942bb013f6f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.297756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.298743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.299020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.299285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] PATH_INFO: `/v3/users/65a3072f22d840099bbb68924d1f07b3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.316154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cd40-a11f-44e5-a02f-a879dbc022b0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.317166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] RBAC: Authorizing `identity:get_user(user_id=65a3072f22d840099bbb68924d1f07b3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.320023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.321938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 146/305] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:00 2022] GET /identity/v3/users/65a3072f22d840099bbb68924d1f07b3 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:00.330836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.366381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.367701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.368512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.369187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.383432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:00.392358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:00.393281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:00.394174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:00.396912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 160/306] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:00.403554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.449421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b2ea-1f93-432a-bb43-ef87dd1632b6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.493072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.494468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.495017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.495430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.496613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, user.id=65a3072f22d840099bbb68924d1f07b3, scope.system=all) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:00.497346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.498970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.506254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 147/307] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 14:36:00 2022] GET /identity/v3/role_assignments?user.id=65a3072f22d840099bbb68924d1f07b3&scope.system=all&role.id=f908b1928f2d46a4b576ec457219471d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:00.512917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794693-379a-4450-920d-0126205bf2e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.551964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.552662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.552944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.553218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.553989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:00.554296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.555811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.570019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 161/308] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:00.571486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.695092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0339e-7297-4b09-96b7-2d5540432ac4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.735976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.736867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.737145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.737457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] PATH_INFO: `/v3/users/0a11dcc4656e4cbf8124e2dea75561f6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.738688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] RBAC: Authorizing `identity:get_user(user_id=0a11dcc4656e4cbf8124e2dea75561f6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.740230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bdf3e-8947-449b-adec-c79d9c36eb9d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.741880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 148/309] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:00 2022] GET /identity/v3/users/0a11dcc4656e4cbf8124e2dea75561f6 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:00.748601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:00.856072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b5ec-aa73-472e-82c7-dabaa80168e4 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:00.890553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:00.891859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:00.892390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:00.892857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] PATH_INFO: `/v3/system/users/0a11dcc4656e4cbf8124e2dea75561f6/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:00.894711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a11dcc4656e4cbf8124e2dea75561f6, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:00.896452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6906-dd12-4861-a254-3984c791f8a3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:00.915886 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 162/310] 10.222.0.21 () {58 vars in 1334 bytes} [Wed May 4 14:36:00 2022] PUT /identity/v3/system/users/0a11dcc4656e4cbf8124e2dea75561f6/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:36:01.496432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59d47-7c89-47fd-a1ec-10425ba55686 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:01.496809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59d47-7c89-47fd-a1ec-10425ba55686 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:01.496981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59d47-7c89-47fd-a1ec-10425ba55686 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:01.498497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 149/311] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:01.503910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:01.504577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:01.505048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:01.522555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:01.523779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:01.590899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 163/312] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:01.613792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b59d47-7c89-47fd-a1ec-10425ba55686 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:01.730056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b59d47-7c89-47fd-a1ec-10425ba55686 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:01.774365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:01.775174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:01.775449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:01.775742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:01.788037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:01.801260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:01.802233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:01.803037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 150/313] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:01.806962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:01.921804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bca18-9094-4ea1-9ea7-31b00a28eee7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:01.977070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:01.977760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:01.978064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:01.978340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:01.979224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:01.979527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:01.980947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:01.990283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 164/314] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:01.995512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:02.100431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8068-746c-4ea0-bd88-a85444f94f6a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:02.136417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:02.137665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.138136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.138618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] PATH_INFO: `/v3/users/1bfa06092b5946999e92e36ca3d4c7e6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.140044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfa06092b5946999e92e36ca3d4c7e6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:02.141724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:02.143977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 151/315] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:01 2022] GET /identity/v3/users/1bfa06092b5946999e92e36ca3d4c7e6 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:02.151701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:02.257967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda2bc-dc37-4c7a-bade-b16833208486 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:02.291761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:02.292419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.292698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.292970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.359988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:02.361474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a0ed6-e116-4a1f-bf4e-ed0d2f855fe7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:02.466665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 165/316] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:02.472777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:02.573742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffc20a-506a-4dff-9862-dba27984ae47 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:02.607407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:02.608551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.608975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.609420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.610843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:02.612713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:02.616156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42785b2-a577-443e-9aa8-1bcc96981dbc None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.620919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 152/317] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:02 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:02.621002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42785b2-a577-443e-9aa8-1bcc96981dbc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.621002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42785b2-a577-443e-9aa8-1bcc96981dbc None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.621984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 166/318] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:36:02.622910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:02.627685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.628284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.628779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.646061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:02.647615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:02.729983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88eaf3-1b2b-48ce-98eb-3f3606de8766 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:02.730945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 167/319] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:02.758440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:02.774972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:02.776436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.776914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.777377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.778787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4, user.id=1bfa06092b5946999e92e36ca3d4c7e6) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:02.779290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:02.780992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:02.791807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 153/320] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:02 2022] GET /identity/v3/role_assignments?user.id=1bfa06092b5946999e92e36ca3d4c7e6&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=f908b1928f2d46a4b576ec457219471d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:02.884747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9585ed-4ee5-43e9-82e4-5e229850f04c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:02.926943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:02.927817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:02.928154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:02.928430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:02.929664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:02.931150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76aba0-52a5-4377-8c33-9e5f79562aa6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:02.933313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 168/321] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:02.939198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.010451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd618f-8a63-49b9-be40-4201e465bc16 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.010742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd618f-8a63-49b9-be40-4201e465bc16 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.011018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd618f-8a63-49b9-be40-4201e465bc16 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.012721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 169/322] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:03.018728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448449f1-fc6a-4833-bae3-72e9504d15bf None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.019009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448449f1-fc6a-4833-bae3-72e9504d15bf None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.019284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448449f1-fc6a-4833-bae3-72e9504d15bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.041988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-448449f1-fc6a-4833-bae3-72e9504d15bf None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:03.043199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-448449f1-fc6a-4833-bae3-72e9504d15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:03.061990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fda5-3d26-476e-8adc-9fe618c63a33 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.099263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.099650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.099957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.100230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] PATH_INFO: `/v3/groups` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.101135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.102885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.126179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 154/323] 10.222.0.21 () {60 vars in 1134 bytes} [Wed May 4 14:36:02 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:03.136244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 170/324] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:03.159498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.277834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d74d1-01df-4c2b-b4a4-853ff2f80bc0 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.308972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a907-3780-4a8b-83ce-788c0c20f66e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.309284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a907-3780-4a8b-83ce-788c0c20f66e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.309559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a907-3780-4a8b-83ce-788c0c20f66e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.311042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 171/325] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:03.316841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.317136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.317397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.319136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.319966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.320244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.320519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.331620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:03.339306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:03.340254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:03.341108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:03.341744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:03.341744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:03.341880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 155/326] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:03.348312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.419858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 172/327] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:03.442970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.462797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ccfa-399c-4746-8199-d64058b9a037 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.503632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.504353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.504634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.504907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.505667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:03.505975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.507401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.516379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 156/328] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:03.523268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.570003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d096c-6601-4056-b0e2-bfba639528eb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.614761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.615594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.616001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.616270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.628185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:03.636064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:03.637187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:03.638117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:03.640432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 173/329] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:03.646167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17399bd6-c7db-4d69-b107-f0a5b6f42ef5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.652774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.681987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.683136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.683560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.684001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] PATH_INFO: `/v3/users/65a3072f22d840099bbb68924d1f07b3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.685386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] RBAC: Authorizing `identity:get_user(user_id=65a3072f22d840099bbb68924d1f07b3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.687083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.689262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 157/330] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/users/65a3072f22d840099bbb68924d1f07b3 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:03.697381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.762644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772db302-6396-4cb5-9c7b-6d23b4d4912b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.800216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.800862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.801243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.801606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.802481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:03.802881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.804547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.810175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2e0a0-1d89-4d0d-b90f-ade1aac72d5f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.814203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 174/331] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:03.819533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:03.849592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.850805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.851270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.851725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] PATH_INFO: `/v3/system/users/65a3072f22d840099bbb68924d1f07b3/roles/f908b1928f2d46a4b576ec457219471d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.853415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=65a3072f22d840099bbb68924d1f07b3, role_id=f908b1928f2d46a4b576ec457219471d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.855054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.867192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 158/332] 10.222.0.21 () {58 vars in 1334 bytes} [Wed May 4 14:36:03 2022] PUT /identity/v3/system/users/65a3072f22d840099bbb68924d1f07b3/roles/f908b1928f2d46a4b576ec457219471d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:36:03.932622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f7d50-507d-4a76-b7d4-d0cf8b21cce9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:03.978359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:03.979323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:03.979602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:03.979898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] PATH_INFO: `/v3/users/0a11dcc4656e4cbf8124e2dea75561f6` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:03.981172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] RBAC: Authorizing `identity:get_user(user_id=0a11dcc4656e4cbf8124e2dea75561f6)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:03.982644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36750d54-d101-424b-8055-8d69c5877806 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:03.984691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 175/333] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/users/0a11dcc4656e4cbf8124e2dea75561f6 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:03.990820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:04.131372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2273ee7-4753-4e0a-abe6-d0bb970bfa98 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:04.172396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:04.173066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:04.173350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:04.173625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:04.174531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] RBAC: Adding query filter params (role.id=81b7812443324595b557a25ca9559d8d, user.id=0a11dcc4656e4cbf8124e2dea75561f6, scope.system=all) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:04.174912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:04.176459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4e689-be2b-406b-8285-ea6ca4f468bc None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:04.195441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 159/334] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 14:36:03 2022] GET /identity/v3/role_assignments?user.id=0a11dcc4656e4cbf8124e2dea75561f6&scope.system=all&role.id=81b7812443324595b557a25ca9559d8d => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:05.908845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f0a8-27ca-4db5-a8b7-cd12ba52d4a9 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:05.909946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f0a8-27ca-4db5-a8b7-cd12ba52d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:05.910423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f0a8-27ca-4db5-a8b7-cd12ba52d4a9 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:05.912279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 176/335] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:05.918966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:05.919442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:05.919522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:05.944722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:05.945936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:06.031514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 160/336] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:06.071422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f0a8-27ca-4db5-a8b7-cd12ba52d4a9 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:06.196765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f0a8-27ca-4db5-a8b7-cd12ba52d4a9 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:06.235391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:06.236629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:06.237230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:06.237705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:06.248718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-47a61aaf-bf4e-4bfc-9a3c-602e0a24c5c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:06.260903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:06.261844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:06.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:06.265418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 177/337] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:06.276852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:06.434632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04948c-fda2-4c7b-830f-6516a60524b7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:06.449654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733439-214d-42e5-98f9-5992c313d5c9 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:06.450261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733439-214d-42e5-98f9-5992c313d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:06.450725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733439-214d-42e5-98f9-5992c313d5c9 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:06.452552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 178/338] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:06.459286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:06.459991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:06.460479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:06.482953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:06.484925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:06.504986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:06.505677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:06.505960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:06.506233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:06.506997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:06.507300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:06.508752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:06.527400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 161/339] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:06.557634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:06.585374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 179/340] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:06.668399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:06.696484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375cc1-d01d-46ca-b933-2c0e4668c37d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:06.739572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:06.740705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:06.740997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:06.741272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:06.839489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:06.841561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:06.941738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306eb4d-1a98-47fc-aadb-91d4823b8e61 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.001189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 162/341] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:07.008363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.016742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.018040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.018598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.019070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.047266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:07.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:07.056974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:07.057803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:07.060655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 180/342] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:07.073954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.161840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212f8f-5066-4ac6-ba47-4e8155777202 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.185564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f74f9-54be-44e7-a045-022058db2052 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.219441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.220233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.220505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.220973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.221808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:07.222111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:07.223500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4525e55-7ef5-45ab-b699-ae04ac9f91ca None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:07.232802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 181/343] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:07.234368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257598-0e6e-4613-abcb-69949553f174 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.234787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257598-0e6e-4613-abcb-69949553f174 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.235296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257598-0e6e-4613-abcb-69949553f174 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.240586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 182/344] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:07.241504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.242494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37257598-0e6e-4613-abcb-69949553f174 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.242608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.242898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.243171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.245183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:07.246717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21daac-9d8f-4063-a0f3-594754a8516a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:07.248656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 163/345] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:07.261413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.261597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.261783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.281084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:07.282368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:07.373616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37257598-0e6e-4613-abcb-69949553f174 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.375547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 164/346] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:07.377658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.427202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.428043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.428628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.428912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.509164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f09a7-70e4-4766-a15e-be3520480806 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.512165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:07.513617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:07.545395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.546264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.546638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.546925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.556023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:07.557806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e24764-3b17-4841-a424-3a82be736be8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:07.560810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 165/347] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:07.562382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37fed-454f-4ffd-b3d1-e0e36fa5eee8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.562885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37fed-454f-4ffd-b3d1-e0e36fa5eee8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.563385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37fed-454f-4ffd-b3d1-e0e36fa5eee8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.565204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 166/348] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:07.566136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37fed-454f-4ffd-b3d1-e0e36fa5eee8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.638737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 183/349] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:36:07.639812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.683416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37fed-454f-4ffd-b3d1-e0e36fa5eee8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.726429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.727272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.727550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.727861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.741632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-67f32b9d-c8d1-4853-9456-743501f34c5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:07.751852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:07.753029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 14:36:07.753931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:07.758298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 167/350] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:07.760081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.760369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.760644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.774248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d44c-4cfb-47ff-bbf1-2154235b2a9e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.780515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:07.781706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:07.819373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:07.820529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:07.821031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:07.821514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:07.822566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=b5e654524ec240dbbf199ca97920650a) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:07.823095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:07.824957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:07.831857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 184/351] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=81b7812443324595b557a25ca9559d8d => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:07.833078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.853617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 168/352] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:07.854967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:07.964756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdceb0-1e84-4d21-a125-f71aa3fa14c4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:07.974804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3094e08-5488-4ce5-a4d5-d0156489d48a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.001218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.001926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.002184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.002895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.003307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:08.003613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.005099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168d5c-6538-4db3-9d41-6a3d9cb0e2f5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.014526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 169/353] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.016206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.017361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.017885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.018405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.020119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.020650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09790b1b-cdf6-46fe-ac4e-b3bb132a6bb0 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.020941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09790b1b-cdf6-46fe-ac4e-b3bb132a6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.021217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09790b1b-cdf6-46fe-ac4e-b3bb132a6bb0 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.022599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c9bf8-7850-4df1-a09f-56b327608d0d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.022993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 170/354] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:08.023845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09790b1b-cdf6-46fe-ac4e-b3bb132a6bb0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.025481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 185/355] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:07 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.028459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.028995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.029486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.047730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:08.049341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:08.135840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09790b1b-cdf6-46fe-ac4e-b3bb132a6bb0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.137301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 186/356] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:08.138511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.172716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.173519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.173796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.174065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.184988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:08.192816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:08.193793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:08.194619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 171/357] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:08.195411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.254468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe1f3-f24b-4e61-b2b1-8cc9364484ec None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.289908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.291262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.291810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.292292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.293736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.295552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.297076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e5bb-3284-47c4-b5c1-f8aec1d2447f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.297776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 187/358] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.298808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.332002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.332929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.333255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.333538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] PATH_INFO: `/v3/users/65a3072f22d840099bbb68924d1f07b3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.334766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] RBAC: Authorizing `identity:get_user(user_id=65a3072f22d840099bbb68924d1f07b3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.336957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.343956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 172/359] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/users/65a3072f22d840099bbb68924d1f07b3 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.343956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.407850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e9ec-15ca-4279-b0d1-b92a37845c90 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.444264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.445094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.445373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.445641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.456979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:08.465053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:08.466126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 188/360] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:08.467144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.469320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dd6c7-738c-4a62-92ef-e7f506122aec None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.521235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.522196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.522471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.522737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.523490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:08.523849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.525250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd28fc-725e-46b4-bb7b-ce088a8327a3 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.539712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 173/361] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.540700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89179c-9c54-48b0-bdf7-12cf66661afe None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.540922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89179c-9c54-48b0-bdf7-12cf66661afe None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.541195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89179c-9c54-48b0-bdf7-12cf66661afe None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.543182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 174/362] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:08.543409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89179c-9c54-48b0-bdf7-12cf66661afe None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.579941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94840-ab92-42f1-bec9-569afffa0258 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.630877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.631577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.632251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.632525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.633661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=b5e654524ec240dbbf199ca97920650a) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:08.634142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.636255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.642257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 189/363] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.642978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.686182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89179c-9c54-48b0-bdf7-12cf66661afe None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.723004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.724104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.724633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.725114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.726213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] RBAC: Adding query filter params (role.id=f908b1928f2d46a4b576ec457219471d, user.id=65a3072f22d840099bbb68924d1f07b3, scope.system=all) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:08.726763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.728569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.743374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 175/364] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/role_assignments?user.id=65a3072f22d840099bbb68924d1f07b3&scope.system=all&role.id=f908b1928f2d46a4b576ec457219471d => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.744652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.759285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfdf81-f245-4731-8a37-e378b812b3d5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.803776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.804620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.804740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.804936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.805713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:08.806021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:08.807451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431dd42-7368-4431-80ab-28155300fcaa None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:08.817602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 190/365] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:08.820131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.820417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.820691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:08.838562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:08.839860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:08.881559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96eabe-827d-49c3-96e5-b34c085b6347 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:08.918116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 191/366] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:08.919112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:08.924236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:08.925300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:08.925787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:08.926311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.003237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.005691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.033017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912befd-3aaa-44f0-9175-01053d699c7b None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.068071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.068660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.068941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.069210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.113842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 176/367] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:09.115097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.143619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.145149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.219124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6755a-2fa4-40ea-846a-deb68902aa32 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.250767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 192/368] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:09.251744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.257514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.258670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.259172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.259645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.271382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:09.279865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:09.280826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:09.281629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:09.284623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 177/369] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:09.285803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.355512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6a11-65c7-469e-9152-7b52c4f1331a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.391141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.392630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.392630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.392630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.393747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852b571-0ad4-48ab-add0-6367e07a649f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.393860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.395301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.397419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 193/370] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.398003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.436904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.438143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.438646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.439120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.440686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.442404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.444367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 178/371] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.445346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.500129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6b811-d6f7-48f6-995c-b227b469e27f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.534948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.535629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.535938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.536213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.536962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:09.537268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.538656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.546813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1601c-2f20-4e44-bb7b-166f7e9663cf None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.548727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 194/372] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.549551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.582803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.584757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.585236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.585747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.587129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.588924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.591223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 179/373] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.592320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.649203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff5c49-109a-4378-a99f-12a799413171 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.683806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.684660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.684936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.685207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.686425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.687945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.691174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 195/374] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.692075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.697069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b285e-a68a-4bf3-8df5-dcf37723da0a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.732074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.733102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.733610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.734073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.796568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872564-36b9-46aa-8a2f-c524a42d9b0c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:09.809110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.811019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.833602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:09.834287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:09.834565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:09.834835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:09.835728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:09.836048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:09.837557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:09.843894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 196/375] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=81b7812443324595b557a25ca9559d8d => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:09.844765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.928392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 180/376] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:09.935724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:09.975563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864ac3-6900-40b3-b398-76e4745335a4 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:10.022087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:10.024327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.024893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.025364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.026453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=7cd009d62e1e46fb83393621bd456bb4) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:10.026993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:10.029817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:10.037738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 197/377] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:10.066870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc4fe-89d0-42d5-b901-5f6c68831e4d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:10.106910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:10.107721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.108003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.108270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] PATH_INFO: `/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.109526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3035cf84fc44f4baa2938e61d4c1c06)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:10.111072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:10.113469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 181/378] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:09 2022] GET /identity/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:10.118808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:10.271275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb193d9-3460-4d7f-8635-e60904015491 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:10.317239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:10.318238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.318511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.318778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] PATH_INFO: `/v3/groups/5661678b8f954aedb7a069bfd3426694` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.331326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] RBAC: Authorizing `identity:get_group(group_id=5661678b8f954aedb7a069bfd3426694)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:10.338305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82988cf1-744a-4062-ae12-83809c5a1709 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:10.340521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 198/379] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:10 2022] GET /identity/v3/groups/5661678b8f954aedb7a069bfd3426694 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:10.348841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:10.487116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411634b-4b87-4b74-9030-8c36438420f3 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:10.526059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:10.526740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.527017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.527290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.528559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] RBAC: Adding query filter params (group.id=5661678b8f954aedb7a069bfd3426694, role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=e3035cf84fc44f4baa2938e61d4c1c06) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:10.528869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:10.530480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42040037-5bb7-430d-8410-a3b22ca0e106 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:10.537747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 182/380] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:10 2022] GET /identity/v3/role_assignments?group.id=5661678b8f954aedb7a069bfd3426694&scope.project.id=e3035cf84fc44f4baa2938e61d4c1c06&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:10.728194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac6f-fdb9-47e8-abe3-ae1f1e4a90f0 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.728467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac6f-fdb9-47e8-abe3-ae1f1e4a90f0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.728737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac6f-fdb9-47e8-abe3-ae1f1e4a90f0 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.730389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 199/381] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:10.737960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:10.738240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:10.738423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:10.764975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:10.766229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:10.863804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 183/382] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:10.883479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010ac6f-fdb9-47e8-abe3-ae1f1e4a90f0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.016375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010ac6f-fdb9-47e8-abe3-ae1f1e4a90f0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:11.064870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:11.066562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.067035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.067479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.089033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:11.097084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:11.098033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:11.099292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 200/383] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:11.106373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.250652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5c8b-f0f7-470f-ba83-417c38f3380f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:11.297466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:11.298518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.299092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.299605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.300610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:11.301112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:11.302757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:11.317069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 184/384] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:11.318846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.492312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119526a-e64b-4a18-8a35-136413872e9d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:11.540585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:11.541511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.541791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.542061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.543530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:11.545029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:11.547018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 201/385] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:11 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:11.553045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.688807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d119f-8d7b-4534-a69d-8f98c0ea6f7c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:11.731289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:11.732615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.733108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.733603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.735038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:11.736785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0736a-9a3c-4e42-8884-302c59f6c4ae None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:11.743880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 185/386] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:11 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:11.745756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.768175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac38b-1eb8-49a6-8e82-79e2b767d191 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.768807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac38b-1eb8-49a6-8e82-79e2b767d191 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.769277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac38b-1eb8-49a6-8e82-79e2b767d191 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.771185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 186/387] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:36:11.778478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:11.779074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:11.779559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:11.797494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:11.799088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:11.895937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 187/388] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:11.921007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:11.937516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c71c-f3b8-4960-b446-d1c4deca714f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.009530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.010441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.010770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.011043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.015201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, group_id=e2a0343f13b6481fad26f4df9d6841ae, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:12.016723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:12.028700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45533ae7-4c3b-4ff9-a606-ac39542931aa None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.038308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 202/389] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 14:36:11 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:12.071994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.073850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.074622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.075162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.092652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:12.101609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:12.103368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:12.104257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:12.112119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 188/390] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:12.115716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:12.273747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd76647-ed04-4dc6-88c8-bafdcd6b8473 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.322064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.322776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.323059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.323338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.324150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:12.324464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:12.325926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:12.336098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 203/391] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:12.344039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:12.481437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84411-5748-4911-b473-a6f60472f199 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.527171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.528904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.529412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.529889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.531548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:12.533374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:12.536853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 189/392] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:12 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:12.541946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:12.676085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfb2f-2ac5-40fb-a0b0-466369d20995 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.713357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.714632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.715125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.715611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.717077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:12.718778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eadfc6-eed7-4ff2-8a58-2d3ac0f83c35 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:12.720744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 204/393] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:12 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:12.726948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:12.864227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2bbbd-e574-4205-9e28-7939997c3bde None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:12.925570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:12.926497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:12.926776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:12.927050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:12.929321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e654524ec240dbbf199ca97920650a, group_id=e2a0343f13b6481fad26f4df9d6841ae, role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:12.930832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8284251-a38d-415d-92c6-6a568413f7f7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:12.952388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 190/394] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 14:36:12 2022] PUT /identity/v3/projects/b5e654524ec240dbbf199ca97920650a/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:13.097247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40def6-f656-4a30-a702-30818d0131c1 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.097636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40def6-f656-4a30-a702-30818d0131c1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.097839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40def6-f656-4a30-a702-30818d0131c1 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.099593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 205/395] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:13.105185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.105487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.105932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.107557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523ece-0691-46cc-b91f-5b76488faf81 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.107872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523ece-0691-46cc-b91f-5b76488faf81 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.108161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523ece-0691-46cc-b91f-5b76488faf81 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.109744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 206/396] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:36:13.115829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.116447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.116447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.137020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:13.140148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:13.149034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:13.154523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:13.262576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 191/397] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:13.277011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 207/398] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:13.288696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.304775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.423758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960bb25-ff25-4ce5-a790-af2b1049b697 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.463703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.464542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.464814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.465079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.478511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:13.487831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:13.488834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:13.490239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 192/399] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:13.496808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.530296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d027-202b-42c3-85b1-db742eb9586c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.573996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.575234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.575735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.576224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.598341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b3aab7b0-e071-4813-bfc8-56fb9f7cced7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:13.608150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:13.609091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:13.609891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:13.613899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 208/400] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:13.615580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e70a0f-6595-45ef-aafe-495744ab529f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.616134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e70a0f-6595-45ef-aafe-495744ab529f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.616604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e70a0f-6595-45ef-aafe-495744ab529f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.618469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 209/401] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:13.622273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e70a0f-6595-45ef-aafe-495744ab529f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.685712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6bb9-7a58-4a68-b8a3-eaf67f827da6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.721788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.722505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.722785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.723054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.723837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:13.724142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:13.725548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd543eb-e0d7-41e6-8174-77e23465e58e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:13.734713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 193/402] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:13.740013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.740297 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.740574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.745180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e70a0f-6595-45ef-aafe-495744ab529f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.758121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:13.759295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:13.781860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.782944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.783431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.783973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.784937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:13.785464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:13.787046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:13.796415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 210/403] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:13.797600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.833655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 194/404] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:13.834606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.905506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe690-42cd-40a6-9b30-b33118c3e426 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.940833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.942012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.942472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.942942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.944436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:13.946108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:13.948086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 211/405] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:13.949209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:13.958837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29b88-b4ca-4e3b-b41f-ac638c139adc None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:13.996389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:13.997148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:13.997422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:13.997689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:13.998880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.000461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.002792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 195/406] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:14.003370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.060667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5406-4192-41db-b3c2-f79de4178083 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.095879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.097076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.097539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.097984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.107942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cff22-f311-4585-a2e8-eff162462f5a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.109262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:14.117187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:14.118537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:14.119387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:14.122308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 212/407] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:14.123326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.149134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.150016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.150289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.150558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.151991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.153610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.159818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 196/408] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:14 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:14.159818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.284077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d8c94-674f-470f-a16d-2e5fffa273ac None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.287978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea78e52-8075-4e9c-b784-80f1a13ff0ac None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.324506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.325864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.326465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.326957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.327969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.328138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:14.328599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.329098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.329467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.329833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.330811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.331362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.332985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.335001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 213/409] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:14 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:14.335655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.341933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 197/410] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:14.348685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.443985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71d79-1086-4796-b2e3-659d078fade5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.455925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7a6a-5655-47ac-a5cd-0211dce77b9c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.483227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.484150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.484426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.484692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.486698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, group_id=e2a0343f13b6481fad26f4df9d6841ae, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.488338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.490805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.491728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.492095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.492252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] PATH_INFO: `/v3/groups/5661678b8f954aedb7a069bfd3426694` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.493564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] RBAC: Authorizing `identity:get_group(group_id=5661678b8f954aedb7a069bfd3426694)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.495086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.502694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 198/411] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:14 2022] GET /identity/v3/groups/5661678b8f954aedb7a069bfd3426694 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:14.503589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.509517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 214/412] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 14:36:14 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:14.521221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.650279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8c33-61dc-4649-9c90-c7e857b3a371 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.699972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.700924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.701201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.701465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.711406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cd009d62e1e46fb83393621bd456bb4, group_id=e2a0343f13b6481fad26f4df9d6841ae, role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.713029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.735839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 199/413] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 14:36:14 2022] PUT /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4/groups/e2a0343f13b6481fad26f4df9d6841ae/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:14.743085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e0eb-d721-4723-9e95-ab5249ef0315 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.791549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.792684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.792978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.793265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] PATH_INFO: `/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.794714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3035cf84fc44f4baa2938e61d4c1c06)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.796322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78927a-50ed-47bd-bfc8-d83fa7d21ca3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:14.798776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 215/414] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:14 2022] GET /identity/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06 => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:14.806991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:14.940338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc0d0-d45a-459b-96ca-e71aa38b2c93 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:14.989754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:14.990720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:14.991001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:14.991270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] PATH_INFO: `/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06/groups/5661678b8f954aedb7a069bfd3426694/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:14.997449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3035cf84fc44f4baa2938e61d4c1c06, group_id=5661678b8f954aedb7a069bfd3426694, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:14.999028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d10b-f8ed-4bdf-a0e2-c94070e54076 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:15.020245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 200/415] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 14:36:14 2022] PUT /identity/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06/groups/5661678b8f954aedb7a069bfd3426694/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:15.338285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139985-a090-480c-8275-1192e7ec2123 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.338747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139985-a090-480c-8275-1192e7ec2123 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.338820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139985-a090-480c-8275-1192e7ec2123 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.340636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 216/416] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:15.346522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba6696-ed59-413a-917b-db2f4bd1e7d1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.347041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba6696-ed59-413a-917b-db2f4bd1e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.347129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba6696-ed59-413a-917b-db2f4bd1e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.371982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f3ba6696-ed59-413a-917b-db2f4bd1e7d1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:15.373225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f3ba6696-ed59-413a-917b-db2f4bd1e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:15.444334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 201/417] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:15.476267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139985-a090-480c-8275-1192e7ec2123 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:15.621947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139985-a090-480c-8275-1192e7ec2123 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:15.671299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:15.672159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.672438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.672712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.688610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:15.692907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf878-d061-42ff-b885-999c251e6fa5 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.693455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf878-d061-42ff-b885-999c251e6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.693939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bf878-d061-42ff-b885-999c251e6fa5 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.695775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 202/418] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:15.699724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:15.700635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:15.701462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 217/419] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:15.704086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:15.704371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.704848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.705301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.734242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:15.735441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:15.812551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68bd7f-4918-4867-9396-f25cd268391a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:15.850163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:15.850988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:15.851164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:15.851391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:15.852184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] RBAC: Adding query filter params (name=member) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:15.852488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:15.853912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:15.863157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 218/420] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:15.868390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:15.887342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 203/421] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:15.918508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.042660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5285b-5ac6-4f02-81d9-a350ab24c33c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.042863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b350e-c0ef-4c85-9976-c96fb5c977ce None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.089027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.090267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.090736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.091192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.103443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.104135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.104416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.104685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.117284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:16.133592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:16.134571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:16.135389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 204/422] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:16.142251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.175871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.177375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.277836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e69f-0502-4234-9a3b-64bc4d2e17fe None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.286704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 219/423] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:16.298327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.317508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.318182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.318455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.318720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.319469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:16.319791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.321206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.337457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 205/424] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:16.346299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.447151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75349b-dba4-4a6a-91f7-b15caa8f8167 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.480560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.481232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.481508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.481779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.515417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6231-5e48-4b14-9b00-3096d11989a8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.549609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.551155 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.605019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.605925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.606205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.606481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.607788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.609275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.611415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 220/425] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:16.616895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.650977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 206/426] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:16.657073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.767086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e3df-4973-4fb2-9af2-0fcc84fe193b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.805918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.806799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.807075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.807346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] PATH_INFO: `/v3/projects/b5e654524ec240dbbf199ca97920650a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.808561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] RBAC: Authorizing `identity:get_project(project_id=b5e654524ec240dbbf199ca97920650a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.810543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.812938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 207/427] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/projects/b5e654524ec240dbbf199ca97920650a => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:16.818154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.851576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb693de0-da7f-4573-a24d-3a8d9d9da823 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:16.910289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:16.911156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:16.911436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:16.911724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:16.913124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:16.914585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:16.916239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 221/428] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:16.926510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:16.983440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74b2a-f45d-43a1-9605-7e39b21930cd None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:17.020199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:17.021969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.022460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.022922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.024373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:17.026081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:17.028660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 208/429] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:17.034877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:17.142890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b11d-75b5-4112-9b0b-67b1f71dc959 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:17.165900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda160-f939-4e37-ad78-31849e492e5e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:17.181092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:17.182121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.182591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.183046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.184104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=b5e654524ec240dbbf199ca97920650a) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:17.184702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:17.186842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81537ef-b28d-4205-af60-09b2d7ac149a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:17.194549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 209/430] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:17 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:17.244842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:17.245715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.246020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.246381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.247233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=b5e654524ec240dbbf199ca97920650a) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:17.247549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:17.249070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf570bf0-5209-4e30-b1b8-b1a781b1c1e0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:17.260057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 222/431] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:16 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=b5e654524ec240dbbf199ca97920650a&role.id=81b7812443324595b557a25ca9559d8d => generated 611 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:17.574040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a021-4ae5-4c66-b185-19ad70812af3 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.575281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a021-4ae5-4c66-b185-19ad70812af3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.575816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a021-4ae5-4c66-b185-19ad70812af3 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.577757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 210/432] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:17.584425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.585368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.585830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.605547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:17.607118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:17.646364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41c51-f97f-45d0-a7db-86114230e8bd None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.646681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41c51-f97f-45d0-a7db-86114230e8bd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.646922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41c51-f97f-45d0-a7db-86114230e8bd None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.648652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 211/433] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:17.656921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.657266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.657476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.680460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:17.682061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:17.691457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 223/434] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:17.721702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:17.776154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 212/435] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:17.803216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:17.840928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5215966-954a-433b-92be-5cfdeb6c2ed9 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:17.889346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:17.890120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.890404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.890671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.904266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:17.913913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:17.914999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:17.915909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:17.917531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 224/436] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:17.923391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b0ac7-a991-4bfe-aba7-d2ad58c67a91 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:17.927361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:17.974388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:17.975529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:17.975929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:17.976264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:17.989264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-36e6742c-2057-4544-bb63-4c51b188dd97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:17.997316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:17.998383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 14:36:17.999372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:18.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 213/437] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:18.002903 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57edc-7e15-4f86-9c3f-be106c98b3e2 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.003421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57edc-7e15-4f86-9c3f-be106c98b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.003927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57edc-7e15-4f86-9c3f-be106c98b3e2 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.005733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 214/438] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:18.008255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee57edc-7e15-4f86-9c3f-be106c98b3e2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.048446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649194f6-185e-4f3b-bfb8-0e61fa3e6efc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.088010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.089818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.089818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.089818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.090063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:18.090296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.091745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64647-5555-4c85-ab8d-ccaf05a53a06 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.100353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 225/439] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:18.105183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.105470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.105735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.122393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:18.123568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:18.126169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee57edc-7e15-4f86-9c3f-be106c98b3e2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.158060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.158779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.159067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.159336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.160126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:18.160432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.161823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.170274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 215/440] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.175345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.187456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 226/441] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:18.188158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.273151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460e7c-1267-431e-b239-611309c0bdc8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.283774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13d98-2744-4aa0-8635-0ed6e6c71096 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.308704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.309450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.309730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.309998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.316722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.317373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.317653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.317923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.381728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.383060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.383276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.384552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.480665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 227/442] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:18.485270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 216/443] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:18.485400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.486319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.580604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6acf5e-d2ec-49b8-9cf5-7141817d9607 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.591610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d9e2-74bd-4a9c-b981-b1eee90acbaf None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.614990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.615827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.616128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.616389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.627849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.628095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:18.628711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.628976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.629251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.630439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.631931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.633615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 217/444] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.634358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:18.636030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:18.636925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:18.637735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 228/445] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:18.639416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.731339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece4a9-f082-4788-8191-d4350adc7bda None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.736581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d112-93ae-435a-a5be-81237f6a8d2e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.765318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.766167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.766440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.766711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] PATH_INFO: `/v3/projects/7cd009d62e1e46fb83393621bd456bb4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.767935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] RBAC: Authorizing `identity:get_project(project_id=7cd009d62e1e46fb83393621bd456bb4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.769419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.771136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 218/446] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/projects/7cd009d62e1e46fb83393621bd456bb4 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.771922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.776564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.777455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.777729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.777998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.779582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.781069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.782696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 229/447] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.783452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.883056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54faa7-b6c8-4b8d-b477-0ebba6f47d79 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.896175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650b1f-d71e-4f74-b1c7-ce3e5682810c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:18.920782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.921463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.921739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.922004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.922761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:18.923054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.924641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.933192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:18.934077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:18.934362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:18.934640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] PATH_INFO: `/v3/groups/e2a0343f13b6481fad26f4df9d6841ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:18.936037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] RBAC: Authorizing `identity:get_group(group_id=e2a0343f13b6481fad26f4df9d6841ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:18.937556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:18.939051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 219/448] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.939569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 230/449] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/groups/e2a0343f13b6481fad26f4df9d6841ae => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:18.939999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:18.950400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:19.055465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957925c-2c9a-4300-8d80-5c5abaaa5968 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.061979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41002726-dcde-4e0e-9fd3-5616dbe1b875 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.087994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.088655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.088947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.089199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.090024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=7cd009d62e1e46fb83393621bd456bb4) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:19.090323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.091813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.095939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.096588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.096867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.097138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.097665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 220/450] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:19.097993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] RBAC: Adding query filter params (group.id=e2a0343f13b6481fad26f4df9d6841ae, role.id=81b7812443324595b557a25ca9559d8d, scope.project.id=7cd009d62e1e46fb83393621bd456bb4) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:19.098287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.098443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:19.099779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.106531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 231/451] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:18 2022] GET /identity/v3/role_assignments?group.id=e2a0343f13b6481fad26f4df9d6841ae&scope.project.id=7cd009d62e1e46fb83393621bd456bb4&role.id=81b7812443324595b557a25ca9559d8d => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:19.221645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3f56-9ac9-4e9a-a5a3-6a30f31f2763 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.263851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.264829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.265324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.265801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.354167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.355966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.461251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 221/452] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:19.467084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:19.583204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1a8a8-f2b7-4ab6-8419-fb668572b156 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.621186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.622509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.622987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.623490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] PATH_INFO: `/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.625828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] RBAC: Authorizing `identity:get_project(project_id=e3035cf84fc44f4baa2938e61d4c1c06)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.627336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.629687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 232/453] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:36:19 2022] GET /identity/v3/projects/e3035cf84fc44f4baa2938e61d4c1c06 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:19.636860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:19.746771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634682-d79f-4ffd-a9b1-15b2faf57290 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.781121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.781970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.782244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.782506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] PATH_INFO: `/v3/groups/5661678b8f954aedb7a069bfd3426694` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.783793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] RBAC: Authorizing `identity:get_group(group_id=5661678b8f954aedb7a069bfd3426694)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.785246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713c60-b836-45bd-9f00-6ccc7d992fb0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.786869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 222/454] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 14:36:19 2022] GET /identity/v3/groups/5661678b8f954aedb7a069bfd3426694 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:19.793531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:19.894420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9bb1-f48b-4927-9cec-3bd5e8fb020e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:19.929128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:19.929775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:19.930056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:19.930322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:19.931149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] RBAC: Adding query filter params (group.id=5661678b8f954aedb7a069bfd3426694, role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=e3035cf84fc44f4baa2938e61d4c1c06) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:19.931451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:19.932933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0e85a-5113-4471-a7b7-be36ec569eb9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:19.938955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 233/455] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 14:36:19 2022] GET /identity/v3/role_assignments?group.id=5661678b8f954aedb7a069bfd3426694&scope.project.id=e3035cf84fc44f4baa2938e61d4c1c06&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:23.050868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d79-9d7e-42ec-844b-fa838769d7c1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.052419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d79-9d7e-42ec-844b-fa838769d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.053375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d79-9d7e-42ec-844b-fa838769d7c1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.056484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 223/456] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:23.067092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138feb6-1180-469e-add3-bec2c1e67fa6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.068606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138feb6-1180-469e-add3-bec2c1e67fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.069340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138feb6-1180-469e-add3-bec2c1e67fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.113434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1138feb6-1180-469e-add3-bec2c1e67fa6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:23.115935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1138feb6-1180-469e-add3-bec2c1e67fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:23.254214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 234/457] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:23.271439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25df52-b0cf-43d4-84dc-38b7e1b292f2 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.272370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25df52-b0cf-43d4-84dc-38b7e1b292f2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.273097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25df52-b0cf-43d4-84dc-38b7e1b292f2 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.276105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 224/458] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:23.282537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4c3b-5202-4fbf-9f1e-36a110ba4f3d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.282832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4c3b-5202-4fbf-9f1e-36a110ba4f3d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.283106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4c3b-5202-4fbf-9f1e-36a110ba4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.295447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25df52-b0cf-43d4-84dc-38b7e1b292f2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:23.305018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7a4a4c3b-5202-4fbf-9f1e-36a110ba4f3d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:23.306130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7a4a4c3b-5202-4fbf-9f1e-36a110ba4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:23.394258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 235/459] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:23.396905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8e04-1e9d-498b-a97b-1c8c1ae504cc None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.397628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8e04-1e9d-498b-a97b-1c8c1ae504cc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.398311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8e04-1e9d-498b-a97b-1c8c1ae504cc None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.404192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 236/460] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:23.411650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.414053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.414755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.438679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:23.440281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:23.516331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25df52-b0cf-43d4-84dc-38b7e1b292f2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:23.525375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 237/461] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:23.526263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:23.576033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:23.577150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.577571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.578001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.589395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:23.591145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:23.609961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:23.611060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:23.612181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:23.612181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:23.612181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.612181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:23.614275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 225/462] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:23.620265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:23.694427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e105b-a6a6-4823-91e3-4d1eb2ad7e4e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:23.722844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c375a-24c1-4bed-953c-c2c443f92197 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:23.754545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:23.755973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.756474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.756963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.757909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfff769-3803-4316-936c-214160c558ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:23.758666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff769-3803-4316-936c-214160c558ac None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.758945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff769-3803-4316-936c-214160c558ac None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.759214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff769-3803-4316-936c-214160c558ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.770803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff769-3803-4316-936c-214160c558ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:23.772339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff769-3803-4316-936c-214160c558ac None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:23.775406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:23.776910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-cbfff769-3803-4316-936c-214160c558ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:23.792353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:23.794147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:23.796534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:23.796534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:23.796534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.796534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:23.796969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:23.806923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 238/463] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:23.808578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 226/464] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170e03-f52a-484d-bdfa-85b609900d8b None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170e03-f52a-484d-bdfa-85b609900d8b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170e03-f52a-484d-bdfa-85b609900d8b None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 227/465] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:23.811980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170e03-f52a-484d-bdfa-85b609900d8b None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:23.929017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda22e3b-6d03-46b0-ab2e-d06889fcf1d5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:23.933912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170e03-f52a-484d-bdfa-85b609900d8b None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:23.984568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:23.986125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.986869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.987565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.989090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:23.989558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:23.990055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:23.990628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:23.991085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:23.991538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:23.992810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:23.993313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:23.993874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:23.995862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a496-93ac-4612-a564-9d397296f8ce None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.016324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 228/466] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:24.018553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.019023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.019473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.027773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 239/467] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:24.029330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.044225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:24.045791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:24.126875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 229/468] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:24.128194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.176669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4a58-0b9f-4c00-bc8c-1c423f6eca94 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.212895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.213492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.213766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.214036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.214772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:24.215070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.216533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.229105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 240/469] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:24.230135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.233376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534be2a-c090-4407-a11a-e630adbc72ea None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.269450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.270121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.270395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.270658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.271365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.272884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.296157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 230/470] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:24.297381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.349574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29918c1-fcb1-4e97-873b-74f54a653ae9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.390540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.391495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.391810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.392084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.393389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.395256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eec8e-6914-448a-ba0f-99ad25de3b27 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.419600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 241/471] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:24.421517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81f2d-ab7d-442f-b832-e52b9823a6d1 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.422099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81f2d-ab7d-442f-b832-e52b9823a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.422606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81f2d-ab7d-442f-b832-e52b9823a6d1 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.429222 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 242/472] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:24.430588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81f2d-ab7d-442f-b832-e52b9823a6d1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.477304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a194b6-4be3-4263-a075-d4c5f311ab6b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.544741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.545987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.546387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.546776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.560779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81f2d-ab7d-442f-b832-e52b9823a6d1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.572823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.577038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.605566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.606293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.606611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.606942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.607818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.609871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-ec4f2ea5-db0d-406b-a217-c3f3a5ad340b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:24.620521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:24.621977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:24.623435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:24.623435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:24.623435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:24.623435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:24.623435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 231/473] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:24.625143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.626619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.632413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.638589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 243/474] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:24.639528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.664259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:24.666581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:24.765301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd81e65-61e7-416f-8501-fbe3b09a2571 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.776182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 232/475] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:24.805442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.810686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.810686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.810686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.811088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.811838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:24.812149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.813716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.828146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 244/476] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:24.834065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:24.926960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105cfa-eeda-4aae-86a1-77a13849c45d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.954610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145e25-0f67-485c-a492-efa75332a42f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:24.965770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.966831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.967313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.967852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.968851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:24.970563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:24.982053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.sql.core [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 14:36:24.982053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 14:36:24.982053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [parameters: {'id': 'de4ca958146d4a03853c6eda1334df62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 14:36:24.982053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86302) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 14:36:24.996908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:24.997606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:24.997897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:24.998170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:24.998911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:25.000455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application conn.query(q) May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application result.read() May 04 14:36:25.015999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return ref.to_dict() May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:36:25.017836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application next(self.gen) May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application yield resource May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application next(self.gen) May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self.session.rollback() May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self.force_reraise() May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise self.value May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application session.commit() May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 14:36:25.019744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._prepare_impl() May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self.session.flush() May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._flush(objects) May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application compat.raise_( May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application flush_context.execute() May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rec.execute(self) May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 14:36:25.021493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:36:25.023370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application conn.query(q) May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application result.read() May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:36:25.024987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [parameters: {'id': 'de4ca958146d4a03853c6eda1334df62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:25.027658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 14:36:25.029859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:25.031507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 245/477] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:36:25.033643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 233/478] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 14:36:24 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:25.043549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:25.247864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b87-50e6-4927-89b0-44a40115c4f8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:25.309748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:25.311012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:25.311506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:25.311951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:25.332473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-8abcd283-f842-42f0-a586-362ba16b903d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:25.340950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:25.342696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:25.344326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 246/479] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:25.352269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:25.500737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1585e2-1946-41ec-91b0-87d3a4fa52e8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:25.543400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:25.544220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:25.544552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:25.544891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:25.545783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:25.546131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:25.547825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9400d-3801-45f5-a956-50af6e438a6e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:25.563949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 234/480] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:27.445146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08272-a866-4d05-ad7f-994a3ed90aed None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:27.446096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08272-a866-4d05-ad7f-994a3ed90aed None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:27.446096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08272-a866-4d05-ad7f-994a3ed90aed None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:27.447421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 247/481] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:27.453328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:27.454301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:27.454768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:27.474896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:27.476575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:27.550674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 235/482] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:27.574033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce08272-a866-4d05-ad7f-994a3ed90aed None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:27.767744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce08272-a866-4d05-ad7f-994a3ed90aed None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:27.819413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:27.820402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:27.820762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:27.821076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:27.834594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-80755bdf-9d02-40de-a88c-cbae368fc443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:27.842495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:27.844471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:27.847471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 248/483] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:27.852411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.010876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73eb5-9a46-4f90-a1a5-74a093897f64 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.011190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73eb5-9a46-4f90-a1a5-74a093897f64 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.011437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73eb5-9a46-4f90-a1a5-74a093897f64 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.013190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 249/484] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:28.019143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.019360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.019654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.034717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd809-5bd7-4307-a3ee-6e02d5b21f56 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.060911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:28.062139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:28.073532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.074234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.074511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.074784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.075578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:28.075909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:28.077356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:28.087196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 236/485] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:28.097131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.215583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 250/486] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:28.280983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebc916-a9f0-441f-9904-ccd758ba1f56 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.300865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.332686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.333528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.333809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.334084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.352269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:28.353772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:28.373415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:28.376260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:28.378694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:28.378694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:28.378694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:28.378694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:28.383719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 237/487] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:28.383719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.433911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f1ba-71eb-4ce6-b876-80be894480cc None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.485142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d50a8-19b4-4dba-8f09-e5d33b11f3e5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.493846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.495086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.495572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.496082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.520975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.521650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.521927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.522196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.522912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:28.523212 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:28.524647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7335-e01d-43d1-84c8-c408fb8b3280 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:28.529154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:28.541860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 238/488] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:28.543893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03746-e4d3-405d-a134-7fbac811c72c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.544189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03746-e4d3-405d-a134-7fbac811c72c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.544455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03746-e4d3-405d-a134-7fbac811c72c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:28.544941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:28.548068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:28.551096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:28.555756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 239/489] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:28.555756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03746-e4d3-405d-a134-7fbac811c72c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.556012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 251/490] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:28.556012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.661944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21e025-701f-4caa-8c79-5f0db08a2310 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.697572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.698226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.698572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.698913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.699911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:28.700285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:28.701778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc36e6-461b-4390-9b87-5aa3e33e920b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:28.715531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 252/491] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:28.717116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.717506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.717850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.729716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03746-e4d3-405d-a134-7fbac811c72c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.735936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:28.737206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:28.791713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.793231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.793940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.794400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:28.814341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:28.817470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:28.824122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 253/492] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:28.825225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:28.854924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:28.857162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:28.859458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 240/493] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:28.864223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:28.951394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0e191-89ee-4356-9105-8f5ec61e9faf None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:28.989070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:28.989989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:28.990269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:28.990605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.001926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.003452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.029499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e69ff-15d3-49fe-928c-fdc5206a3c3b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:29.037022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:29.038005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:29.038899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:29.038899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:29.038899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:29.038899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:29.044069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 254/494] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:29.044069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.083034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.084517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.084963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.085452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.104585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3b42ba7e-d62b-4cce-97ef-f4ed1bda72fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:29.119328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:29.120628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:29.121508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:29.122137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 241/495] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:29.123920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77394-4afc-4138-8edb-4b886423d051 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.124411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77394-4afc-4138-8edb-4b886423d051 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.124889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77394-4afc-4138-8edb-4b886423d051 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.127609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 242/496] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:29.128965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77394-4afc-4138-8edb-4b886423d051 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.173599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd70b-1a23-4841-a03d-575ede0415a8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.214839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.215528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.215851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.216119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.216994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:29.217307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.218847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.263104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 255/497] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:29.263104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.295564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77394-4afc-4138-8edb-4b886423d051 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.332679 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.333735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.334225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.334558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.335351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:29.335755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.337242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8382e1-a0db-4727-980f-9fbf9882aaf5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.349819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 243/498] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:29.351039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.351321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.351596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.370021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:29.371504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:29.387439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d559-3ff0-455e-b111-54c01268ef5f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.436872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.437962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.438427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.438883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.440237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:29.440758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.443306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.450365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 244/499] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:29.451242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.455302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 256/500] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:29.456324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.594341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff2a63-28ba-4dc5-bb77-95661956f02c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.601131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3c2f2-3dca-47ca-a881-66c987dc8b3c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.633620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.634280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.634563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.634836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.637400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.638203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.638471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.638744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.646559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.648048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d8cc5d86-9817-4ae4-a0c7-04019d0ff99b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:29.665343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:29.666399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:29.667312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 257/501] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:29.667954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c495f-5634-44b4-95dc-b1ee76c304ac None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.668486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c495f-5634-44b4-95dc-b1ee76c304ac None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.668486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c495f-5634-44b4-95dc-b1ee76c304ac None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.669634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 258/502] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:29.670627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c495f-5634-44b4-95dc-b1ee76c304ac None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.707101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.708675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.769463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c495f-5634-44b4-95dc-b1ee76c304ac None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.802319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.803242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.803525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.803807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.812983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 245/503] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:29.813840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.819814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.821304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:29.839260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:29.840371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 259/504] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:29.841426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:29.921934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d019b-8a56-447b-a5bb-0b32f5a86d56 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.944319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5585e-a39d-4062-952a-de28726fd745 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:29.974640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.975841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.976292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.976768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.978066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:29.978746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:29.979029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:29.979300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:29.980181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:29.980486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:29.981955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9750662-d651-4a6f-b3b7-a007889aed2e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:29.995116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:30.002879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 260/505] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:30.004191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.004512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.004801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:30.010640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:30.011971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:30.013512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 246/506] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:30.014905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.022453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:30.023691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:30.105854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 261/507] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:30.107134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.130757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dce51-0e71-419e-b63f-6e52a5b2b0dc None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.177795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.178884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.179336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.179799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.196628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.199174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:30.230332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:30.231306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:30.232320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:30.232320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:30.232320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.232320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:30.232567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 247/508] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:30.233407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.256326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328809-6c39-4007-a40f-79b9cb8521e4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.289797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.290459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.290741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.291014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.291768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:30.292069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.293446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.304789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 262/509] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:30.305627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.355968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c770565-4d1f-4211-9ce5-acd057acdd32 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.394532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.395188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.395462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.395765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.410908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1582-7e45-424c-86f5-e9756080699e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.444531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.445115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.445396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.445670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.446455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:30.446735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.448180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.456958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 263/510] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:30.457800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.474868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.477334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.567918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106723aa-c919-441a-b80a-0dab0bae70b1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.603100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.604441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.604608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 248/511] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:30.605169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.605308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.605433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.623588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.626243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:30.658767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:30.660015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:30.660898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:30.660898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:30.660898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.660898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:30.669137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 264/512] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:30.669137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.703889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dddf6-7bc9-4a45-b513-9870e1d3183f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.738015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.738670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.738962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.739224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.739972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:30.740271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.741685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.752511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 249/513] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:30.753306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.781226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2786-b1f1-441c-b714-9969a9de44cc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.816947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.817758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.818036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.818298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.825634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.827110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:30.841865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:30.842885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:30.843875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:30.847928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 265/514] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:30.848837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.856744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e56a-31d8-4b96-a3ae-c28132ac28b8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.889632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.890420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.890698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.890962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.901735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.903544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:30.920364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:30.921309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:30.922177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:30.922177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:30.922177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:30.922177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:30.926146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 250/515] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:30.927009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:30.944663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b51-9c20-42fa-a8e8-e182cfacf570 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:30.976563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:30.977242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:30.977513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:30.977780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:30.987574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:30.989082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:31.006265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:31.007367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:31.009196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:31.009196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:31.009196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:31.009196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:31.012100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 266/516] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:31.013445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.026435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b348f7a-3723-4788-9546-7a3106c87949 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.075100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.076232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.076690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.077144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.078407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:31.078902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.081306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.093782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 251/517] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:31.094618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.145283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfea1-6e90-4406-8609-fce85ae14bc8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.182328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.183136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.183409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.183698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.190940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.192482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.194119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be25b7-ae08-43c7-ae12-ca23630990e7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:31.207842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:31.208818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:31.209686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 267/518] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:31.210222 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.231890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.232492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.232774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.233050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.233902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:31.234276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.235812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.273852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 252/519] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:31.274714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.319036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1a5af-1e68-46d7-a28e-3792499122c2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.359179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.360024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.360347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.360662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.361554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:31.361903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.363359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.376959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 268/520] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:31.377165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4228b4-da2e-4012-aed0-b116745faed6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.378304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.413772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.414771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.415200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.415641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.416780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:31.417158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.418702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.431028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 253/521] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:31.431976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.485073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16682-29f6-4860-bff9-2dc3f6f59628 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.516763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.517436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.517737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.518009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.518706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.520194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.531074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b689-fd16-4105-bd5f-b861c9808eca None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.541058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 269/522] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:31 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:31.541874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.566748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.567521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.567919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.568258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.569223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:31.569604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.571177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.595567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 254/523] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:31.595567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.650877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdbe9-e72b-4ac4-b142-fb898a18400a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.687125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.687937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.688218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.688488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.715899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2237503-d7ee-4eea-b308-cece361f8be4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.761934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.762683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.762965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.763241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.765255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.766732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.771897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.773487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:31.788655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:31.789615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:31.790504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 255/524] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:31.791056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.873169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 270/525] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:31.874406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.914911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6acda-9278-4ff3-a79c-5eaf92f1903a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:31.948513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:31.949305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:31.949585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:31.949850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:31.956718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:31.958204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:31.972762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:31.973845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 256/526] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:31.974741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:31.978008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ea48-539b-4097-9a57-a76127420828 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.011839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.012546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.012766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.013036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.013854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:32.014159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.015588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.027700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 271/527] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:32.027700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.092942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686f2e-5d67-468d-a432-84532b3acc42 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.130706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.131557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.132002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.132224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1a0eb-8fbe-4ddf-a075-074ab4968891 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.132450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.133381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:32.133842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.136701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.169022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 257/528] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 14:36:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:32.170904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.174210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.175040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.175314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.175581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.187701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.189224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:32.207805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:32.208757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:32.209614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:32.209614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:32.209614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:32.209614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:32.213875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 272/529] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:32.214842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.312821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe893b-fd8d-48a6-a58b-efc5cda452f1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.342319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4c506-77d1-40f4-af3b-afa773170376 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.358004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.358693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.358967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.359234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.360055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:32.360355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.361889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.373950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 258/530] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:32.374793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.387921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.388894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.389462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.389747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.468995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.470618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.479969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87a7e7-941b-4fcf-9e79-905936a8b887 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.513644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.514319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.514636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.514857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.515585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:32.515982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.518494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.531717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 259/531] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:32.532459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.576951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 273/532] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:32.577810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.630982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fd46-eb66-42d7-80e2-e6cbbcf29064 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.666137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.666836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.667277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.667608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.669071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=3408c447488e472399394fdd26215a8d) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:32.669388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.671626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.673407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806da6c-6cb2-4e3f-8825-0c58ab2db094 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.678604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 260/533] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/role_assignments?user.id=3408c447488e472399394fdd26215a8d&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:32.679421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.796727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.797741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.798074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.798350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.802776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fa57-22d3-4b4d-a057-39226b5dbf62 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:32.817015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.818552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.842953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:32.843499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:32.845153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:32.847040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:32.847882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:32.847882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:32.847882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:32.852578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 274/534] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:32.856160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:32.857717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:32.859071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:32.879332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:32.881186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:32.883179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:32.883179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:32.883179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:32.883179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:32.883179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 261/535] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:32.892872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:33.026457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ce20-0256-4e06-8630-2a027f674e80 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.062732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619ae6-62ea-4f0b-9104-4fcab5f58e70 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.063063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.063759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.064039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.064397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.065187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:33.065567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.071696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.088503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 262/536] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:33.096741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:33.126389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.128192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.128972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.129727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.131557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:33.132346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.135543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.184743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 275/537] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:33.198741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:33.354511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb3ad-af63-46eb-a74f-0f2f081c1881 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.390841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.392034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.392606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.393102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.400470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.402228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.424769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17b51-a8d4-4ae1-9f6e-7196ab254192 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:33.433747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:33.434750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:33.435614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:33.444960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 263/538] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:33.452791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:33.471025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.471747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.472016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.472296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.473113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=5cb06fb2f9574061859dc8e25ec44bb2) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:33.473417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.474869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.481021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 276/539] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:33 2022] GET /identity/v3/role_assignments?user.id=5cb06fb2f9574061859dc8e25ec44bb2&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:33.564504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8fc1-1c9f-43fc-97e4-ada94f7d8143 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.603053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.603774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.604052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.604318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.605203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:33.605452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.606994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589ba11-b0ec-4bc8-b5a2-9baea6bcd12d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.620063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 264/540] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:33.626111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:33.734975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ad02d-d042-45bb-b5e9-b1b90f281121 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:33.770017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:33.770692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:33.770969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:33.771240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:33.772126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=735bc87032af455c8900fafe88496ba2) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:33.772433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:33.773939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d23a1-47ad-4ec1-9a17-218afff9effa None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:33.781337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 277/541] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:33 2022] GET /identity/v3/role_assignments?user.id=735bc87032af455c8900fafe88496ba2&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:34.216474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb3d76-ebb0-4d80-9590-3b38698056ef None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.217032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb3d76-ebb0-4d80-9590-3b38698056ef None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.217032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb3d76-ebb0-4d80-9590-3b38698056ef None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.218360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 265/542] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:34.224514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.224788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.225064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.250730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:34.252084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:34.372789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 278/543] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:34.435974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb3d76-ebb0-4d80-9590-3b38698056ef None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:34.563542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb3d76-ebb0-4d80-9590-3b38698056ef None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:34.597912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:34.598723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.598998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.599268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.610600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:34.618399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:34.619376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:34.620223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 266/544] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:34.629257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:34.767341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658e30-bc8d-4715-a59f-7c134651b617 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:34.817820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:34.818433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.818717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.818989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.819787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:34.820105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:34.821578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35b7c-d82c-45fa-a392-e63b255bd086 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:34.835167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 279/545] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:34.845770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:34.940597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7bbbf-4b40-40ee-815e-94ab2c4d6eae None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.940922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7bbbf-4b40-40ee-815e-94ab2c4d6eae None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.941143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7bbbf-4b40-40ee-815e-94ab2c4d6eae None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.942933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 280/546] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:36:34.949471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:34.949785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:34.949931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:34.975411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:34.976621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:34.984223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c137c-d6ae-48d0-a6b8-74478ab2a146 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.055232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.056096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.056371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.056639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.077503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.078914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.082070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 281/547] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:35.106767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:35.120916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:35.121885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:35.122849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:35.122849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:35.122849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:35.122849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:35.123069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 267/548] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:35.129293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.281586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad350c6-e021-4ca6-81ba-045cc898f72a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.315875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.316687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.316962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.317229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.340063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:35.348055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:35.348973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:35.349811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:35.352610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 282/549] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:35.359483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.383901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5983a-bd78-4e03-b58c-86cf7d6a014d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.422916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.424113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.424585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.425043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.426489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:35.427002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.428604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb72c5-3553-4319-8d89-188268add8ed None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.448378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 268/550] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:35.449888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4eacd-8ea9-407e-ac6a-49081dc71059 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.450180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4eacd-8ea9-407e-ac6a-49081dc71059 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.450454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4eacd-8ea9-407e-ac6a-49081dc71059 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.452414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 269/551] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:35.453226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4eacd-8ea9-407e-ac6a-49081dc71059 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.507129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb00e-ad5f-44c4-b88f-46e39be54254 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.548534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.549292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.549614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.549890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.550652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:35.550960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.552521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cda26-b3fc-4339-ab38-f985c5cd1c9c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.568364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 283/552] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:35.569733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.570049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.570352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.571170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4eacd-8ea9-407e-ac6a-49081dc71059 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.587155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:35.588309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:35.606405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.607203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.607481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.607777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.615425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.616935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:35.631821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:35.632773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:35.633674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 270/553] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:35.634879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.663289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 284/554] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:35.664341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.754277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850279-7803-4cfb-b639-2d7f87a9962b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.766511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54829-db08-4e28-befd-09e7bdd64bce None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.790482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.791323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.791605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.791926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.803265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.804819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.805165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.806504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.806922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.807327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.808342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:35.808832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.810522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:35.824469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:35.825411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:35.826288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:35.826288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:35.826288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:35.826288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:35.826288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 271/555] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:35.826563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.839033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 285/556] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:35.840172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:35.941870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c059-77e7-4074-9709-12ca685617a4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.947480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e693e-c8e9-4a77-842a-cc9e20326920 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:35.976790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.977819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.977934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.978135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.982818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:35.983737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:35.984244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:35.984712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:35.985583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:35.986023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:35.987618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:35.989671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:35.997717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:35.998950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:36.000046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:36.007786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 272/557] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:36.007786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.008037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 286/558] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:36.008735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.125596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b34cf5-b2d1-4669-bdd4-3c298e95bf88 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.125770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91440af6-d9c3-4d2f-aa4e-9eedc432c973 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.160554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.160975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.161217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.161497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.161768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.162628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.163100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.163555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.164557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:36.165067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.166643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.175870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 287/559] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:36.177091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.236556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.238088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.282367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3c06-cdbb-4c0d-8e88-ce412617f31b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.316753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.317966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.318448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.318933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.339586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.341439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.346852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 273/560] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:36.347850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:36.357065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:36.358015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:36.358927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:36.361718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 288/561] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:36.367539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.455801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28728b6-5ba1-4b97-a3e2-b7ad1c4809fa None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.486718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5d254-f42d-448e-8fca-8369d28ddb3a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.491403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.492231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.492509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.492771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.503849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.505487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.522788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.523600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.523929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.524202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:36.524387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:36.525763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 274/562] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:36.526816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.542674 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.544184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-a98e1b2b-aba8-439c-9e19-8ae98630c07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:36.561611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:36.562717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:36.564035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:36.564035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:36.564035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.564035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:36.564035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 289/563] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:36.564422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39eeb-2f09-4ad6-a901-7c46281ba817 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.564422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39eeb-2f09-4ad6-a901-7c46281ba817 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.564828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39eeb-2f09-4ad6-a901-7c46281ba817 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.570100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 290/564] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:36.570100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e39eeb-2f09-4ad6-a901-7c46281ba817 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.632223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac981a-3592-4c60-bfd9-dd71fb5a3fb5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.666776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.667450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.667765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.668038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.668875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:36.669175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.670636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.673570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e39eeb-2f09-4ad6-a901-7c46281ba817 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.688566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 275/565] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:36.689661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.713835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.714420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.714703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.714975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.715726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:36.716042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.717423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c966b1-497f-4797-bdfc-83897c6456d7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.728760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 291/566] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:36.730121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.730410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.730685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.747416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:36.748662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:36.787624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da45de-3eca-4fb3-814c-87d857e57e09 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.813941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 292/567] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:36.814858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.827641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.828332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.828611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.828875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.829604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:36.829939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.831371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2038f-f58a-4924-b163-4db7d1d0257b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.843765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 276/568] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:36.845165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f2-a8a8-48e9-b0a6-149e2fdcc810 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.845473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f2-a8a8-48e9-b0a6-149e2fdcc810 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.845779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f2-a8a8-48e9-b0a6-149e2fdcc810 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.847083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 277/569] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:36.848084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8682f2-a8a8-48e9-b0a6-149e2fdcc810 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.913159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6205432-adcb-47eb-ad03-551609d28b6b None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.949121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8682f2-a8a8-48e9-b0a6-149e2fdcc810 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:36.952903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.953724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.954002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.954269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:36.965900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:36.967327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:36.985708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:36.986819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:36.987741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:36.987741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:36.987741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:36.987741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:36.987741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 293/570] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:36.988043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:36.988136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:36.988207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:36.988385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:36.988676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.000177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.001639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:37.015636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.016763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 278/571] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.018533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.096704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21246-5bb6-40d9-a37d-d76728dd7e15 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.118814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff115c16-07fe-4522-a05e-4c8c4fe26de9 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.132900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.133699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.133976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.134245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.144321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:37.151391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-71d42485-1c86-4939-85e1-e4dddd31d446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:37.151915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.152840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:37.154004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:37.154689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.154689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.154689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.154954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 294/572] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.154954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.154954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.155139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.162392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.163947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.171751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:37.172975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:37.177974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.178941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:37.179869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 279/573] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.180463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.239415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 295/574] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:37.240220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.275610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d024e4-4af6-411a-84ed-d9941bf166a6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.309207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.309875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.310138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.310405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.311117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:37.311419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.312839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.329452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 280/575] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:37.329452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.347010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e91cc-26dc-4302-a444-1355b4da3de7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.379140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.379839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.380140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.380406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.381210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:37.381538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.382939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.399429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 296/576] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:37.400280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.426590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332213dc-80ff-4714-aa54-751a08e35c16 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.459687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.460363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.460625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.460897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.461642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:37.461941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.463328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.471706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 281/577] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:37.472260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.499614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923101-bef2-405a-8f24-cc0da9d90469 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.532993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.533780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.534051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.534336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.535170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:37.535478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.536953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.548679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 297/578] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:37.549492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.570387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dfe78-4e33-433f-b5ef-a394f88ed60c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.602422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.603207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.603482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.603781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.613957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:37.621547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.622689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 282/579] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.628790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.646626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bdd54-716e-4ca9-8ec9-245d6aedf266 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.681518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.682314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.682591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.682844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.689588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.691026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:37.705300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.706380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 298/580] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.712144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.719787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2d1-8bc2-44e9-b1ae-1132fe98a234 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.751608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.752372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.752644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.752907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.764110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.765577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:37.782467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.783469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 283/581] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.784493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.808887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582fc6-6736-48f1-a65a-42c261c9dfb3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.844338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.845131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.845408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.845662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.855802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.857280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:37.875289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:37.876345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:37.877624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:37.877624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:37.877624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:37.877624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:37.877624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 299/582] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:37.877919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba738-4768-4625-b9e2-9d74519d059e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:37.877995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.909781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:37.910386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:37.910662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:37.910931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:37.911791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=66ba10ffb7804f6e9a05ae87d2c249c0) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:37.912103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:37.913665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:37.919064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 284/583] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/role_assignments?user.id=66ba10ffb7804f6e9a05ae87d2c249c0&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:37.919895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:37.992699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9310f-de51-437d-ab3d-f8e5630fbd79 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.029900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.030427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ce850-ffa1-4b27-966a-1271b15236c1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.030537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.030756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.031026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.031826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.032154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.033643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.042307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 300/584] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.043177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.076432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.076432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.076432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.076432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.077175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.077175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.077625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.091566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 285/585] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.093426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.155316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bbef-2f90-413e-b33a-55a61167464a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.188131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.188794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.189073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.189410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.190129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.190434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.191843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.198882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b23b5-3eca-49b6-aadb-34cc5d2e0b0d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.207698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 301/586] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.207698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.234542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.235207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.235482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.235787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.236542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.236846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.238293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.249736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 286/587] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.250542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.309043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a667-4a47-4de6-9c7f-ae4e54b8f048 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.354621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.356014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.356300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.356574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.357583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d76e-ac11-4120-ac94-129a79d0f892 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.367959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.369428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:38.386546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:38.387526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:38.388742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:38.388742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:38.388742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:38.388742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:38.390650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.391537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.391847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.392438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.392553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 302/588] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:38.393413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.407243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=d9052eeac18b49d79f81f1a3ec919c61, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.408838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.431697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 287/589] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:38 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:38.431697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.523488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3525cb-10da-411a-bfaf-b749121ffa69 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.531285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3faf-0fba-4bc7-8785-895e531d467e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.560806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.561538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.561877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.562147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.569943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.570164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.570901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.571172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.571436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.571554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.580028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.581632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:38.588398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:38.589397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:38.590309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:38.594519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 303/590] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:38.595610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:38.598250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:38.600397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:38.602621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:38.603909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 288/591] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:38.611695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.700220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114b90-f425-41f1-b136-ceebfe379b69 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.710020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042d425-86fc-4d6d-92df-3b0128fc0ce1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.734544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.735247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.735529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.735826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.736588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.736884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.738269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.745008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.745673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.745952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.746281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.747071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.747378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.748883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.750181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 304/592] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.751027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.766752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 289/593] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.767715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.856371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e431-af75-4ac9-b789-bf0ae3a0b1d7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.868003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880135a-8b67-4380-953d-e05780402f9d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:38.890074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.890747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.891021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.891289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.892150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:38.892503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.893939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.902243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:38.903357 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:38.903633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:38.903929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:38.912063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:38.912511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 305/594] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:38.913333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:38.918110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:38.933417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:38.935788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:38.938189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:38.939815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 290/595] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:38.943700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.017057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36755e-7c08-4880-85cd-05cbf9119fd0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.044290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3872f7-ea14-49b0-83de-e1acf73db17b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.051823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.052715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.052989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.053256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/3408c447488e472399394fdd26215a8d/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.070900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=3408c447488e472399394fdd26215a8d, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.072478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.086368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.087322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.087609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.087913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.091785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 306/596] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:38 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/3408c447488e472399394fdd26215a8d/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:39.092841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.121818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.123315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:39.153549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:39.155974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:39.158252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:39.158252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:39.158252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:39.158252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:39.158812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 291/597] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:39.175698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.334849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c0fb-b015-4b11-8675-f234c6d5d1ef None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.376389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.377089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.377358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.377628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.378484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:39.378789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.382177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.392586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e988be3-6584-4ae3-ab3d-96e5cd4b9e5f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.401638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 307/598] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:39.409050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.442319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.443274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.443554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.444050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.445124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:39.445431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.447260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.463290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 292/599] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:39.469280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.581602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6446-4d35-4d4b-b716-cfcdfa565a98 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.633258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.634212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.634649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.635014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.659487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.661271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.676631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f45-478e-4d23-9728-6417dfc39fed None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:39.711700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:39.712816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:39.713865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:39.713865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:39.713865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:39.713865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:39.716230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 308/600] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:39.722882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.754220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.756149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.756351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.756962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.783278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.784975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:39.819467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:39.820693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:39.821612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 293/601] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:39.827328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.849117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff5fc-23b6-45a9-b5a6-691e7650e8e1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:39.889043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:39.890620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:39.891115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:39.891629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:39.892748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:39.893313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:39.895025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:39.909034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 309/602] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:39.921044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:39.969825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76be54d-c9df-434f-a1f1-10bbc2704d79 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.045489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.046211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.046494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.046768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.047567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:40.047901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:40.049566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:40.061073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988eef-dbd5-4f18-86e1-e1815aaf14fa None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.080237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 294/603] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:40.086365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:40.110963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.111941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.112219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.112492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.127931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:40.129542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:40.156622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:40.157818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:40.159041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:40.163842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 310/604] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:40.171555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:40.210796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1019b-7f85-43a9-aeb9-de1bce36a69f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.268522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.269443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.269831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.270032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/5cb06fb2f9574061859dc8e25ec44bb2/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.296949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=5cb06fb2f9574061859dc8e25ec44bb2, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:40.298485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:40.317852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 295/605] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:40 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/5cb06fb2f9574061859dc8e25ec44bb2/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:36:40.387401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123153cc-1f2b-4a00-bac4-09e3a4e2f0e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.443515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.444291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.444612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.445041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.446052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:40.446398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:40.448179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9499b9-a6b5-4076-9659-a2cbd34e86d5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:40.475903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 311/606] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:40.478006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:40.493837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074021-4b2f-4bcf-ad89-a543215606c8 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.494186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074021-4b2f-4bcf-ad89-a543215606c8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.494411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074021-4b2f-4bcf-ad89-a543215606c8 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.496403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 312/607] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:40.503387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.503842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.504374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.540037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:40.541275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:40.638554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668e7c-4321-471a-afdd-ef0737b7dcd5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.647801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 313/608] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:40.682718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:40.695881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.699112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.699425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.699850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/735bc87032af455c8900fafe88496ba2/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.735408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=735bc87032af455c8900fafe88496ba2, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:40.736984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:40.763002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 296/609] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:40 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/735bc87032af455c8900fafe88496ba2/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:40.831896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27fc7-4655-4fc7-a999-8e15864e6747 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:40.879797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:40.880759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:40.881039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:40.881332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:40.898052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:40.906507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:40.907531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:40.908457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:40.912200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 314/610] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:40.918407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.119036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968046b-075e-44af-ab6b-cd38cbc7250b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.181800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:41.182997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.183513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.184034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.185574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:41.186126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:41.188978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920fa32-32e4-45a1-a5a5-edc2d878baf9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:41.205675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 297/611] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:41.211361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.265813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453355-bb55-483c-9bed-75b731822e68 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.266149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453355-bb55-483c-9bed-75b731822e68 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.266367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453355-bb55-483c-9bed-75b731822e68 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.268168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 298/612] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:41.273904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.274215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.274462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.297973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:41.299406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:41.401006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 299/613] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:41.417617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762050ea-c8c1-46b5-8e5e-da86dc91dfd7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.445190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.476375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:41.477407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.477960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.478276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.496908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:41.498409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:41.531196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:41.532193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:41.533909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:41.533909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:41.533909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:41.533909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:41.533909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 315/614] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:41.539023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.611417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7e0d-d8b5-4700-be57-66f5dc5a22ea None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.668504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:41.669323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.669965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.669965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.682371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442817e0-9727-416e-8f18-22a9874f48e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.692967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:41.713818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:41.715245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:41.716773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 300/615] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:41.721383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:41.722359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.722850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.723312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.724321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:41.724752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.725066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:41.726726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:41.740344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 316/616] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:41.748171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:41.940133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1e9b-9fac-4d91-9831-15aafe1bc190 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.946860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318696a-577b-43e9-bc70-76d87a4dd5a2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:41.977030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:41.978276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:41.978783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:41.979256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:41.987377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:41.989180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:42.004703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:42.005724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:42.006661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:42.009415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 317/617] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:42.019358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.025787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.026888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.027356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.027850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.029505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:42.030021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.037360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.063888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 301/618] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:42.069676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.123927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a9e1-c589-45e8-b44c-ab5916a3d4f2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.160484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.161376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.161685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.161990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.163415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:42.163971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.166546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd6fdd-35fd-49d7-b67b-d593c62f920a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.185281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 318/619] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:42.186638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b2d42-ff22-4bfa-b409-f6c47310e16c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.186921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b2d42-ff22-4bfa-b409-f6c47310e16c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.187193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b2d42-ff22-4bfa-b409-f6c47310e16c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.193368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 319/620] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:42.194104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b2d42-ff22-4bfa-b409-f6c47310e16c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.248817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85032-88a7-4531-aa79-1b599f36a9e7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.300355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b2d42-ff22-4bfa-b409-f6c47310e16c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.310909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.313018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.313495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.313960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.333841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.335343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.354915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.356079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.356507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6b3713d2-b019-4731-b433-64aee836fc25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:42.356781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:42.357817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:42.358798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:42.358798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:42.358798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:42.358798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:42.359249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.362905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 302/621] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:42.364800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.365085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.365362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.373378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.375245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.385541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:42.386908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:42.395722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:42.396929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:42.397981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:42.397981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:42.397981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:42.397981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:42.400053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 320/622] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:42.401187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.486221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 303/623] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:42.487599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.538302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8278b-a79a-4f38-a694-8eeb6dd3a930 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.580509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.581178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.581456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.581754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.582596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:42.582909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.584755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.607137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 321/624] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:42.608283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.612597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd24f9-9b05-486d-937a-60889443a54c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.676361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.678045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.678846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.679773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.681521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:42.682168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.685240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.698720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 304/625] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:42.699967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.743115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf08fa-6c44-49fa-8473-a329a9512719 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.785345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.786204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.786477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.786762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.803015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:42.812665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:42.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 322/626] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:42.816364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.835119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac462c-3fdc-4bff-b13b-797f75955cbe None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.879479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.880765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.881417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.882152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.896941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.900108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:42.924724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:42.926029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:42.927042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:42.931646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 305/627] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:42.932899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:42.940590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b43a8-baa8-4746-92c2-5a9c555c9915 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:42.984266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:42.985229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:42.985530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:42.985789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:42.995260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:42.997320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:43.015623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:43.016859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:43.021002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:43.021730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 323/628] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:43.022969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.092514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427d8f7-d812-48c2-9038-2f830507004f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.128537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.129593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.130263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.130920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.131948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:43.132529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.134350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.144185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 306/629] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:43.145573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.166984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b119-4d5c-41be-bf1f-865eb9a1b0ef None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.211838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.212532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.212806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.213073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.213935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:43.214241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.215741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.234978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 324/630] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:43.237043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.267853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c52f-4862-41ab-8edb-334983f7ab5a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.307335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.308095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.308372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.308643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.309497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:43.309797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.311313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553655-b8f9-4862-a9b8-657b13bedc25 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.337545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 307/631] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:43.338902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f60fd-94e5-430d-9e0f-222ce0be5791 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.339185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f60fd-94e5-430d-9e0f-222ce0be5791 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.339512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f60fd-94e5-430d-9e0f-222ce0be5791 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.341097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 308/632] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:43.344618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f60fd-94e5-430d-9e0f-222ce0be5791 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.358913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962499e-8f83-4f81-816e-7335ed97ded6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.396875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.397717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.397996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.398265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.410317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.411891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:43.431710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:43.432722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:43.433700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:43.433700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:43.433700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:43.433700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:43.439864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 325/633] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:43.440806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.462854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f60fd-94e5-430d-9e0f-222ce0be5791 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.502422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.509416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.509416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.509416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.548237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548de84-2539-489b-b0ee-d33b368304f7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.579866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.581401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.585766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.586671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.586946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.587214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/66ba10ffb7804f6e9a05ae87d2c249c0/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.602334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=66ba10ffb7804f6e9a05ae87d2c249c0, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.603909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607bd5-ad63-41c6-97ac-51dee7fd3226 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.617727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 326/634] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:43 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/66ba10ffb7804f6e9a05ae87d2c249c0/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:36:43.627931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd0-abe9-41d5-aca0-388073f0e3ce None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.627931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd0-abe9-41d5-aca0-388073f0e3ce None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.627931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd0-abe9-41d5-aca0-388073f0e3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.640040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-38ea0dd0-abe9-41d5-aca0-388073f0e3ce None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:43.641625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-38ea0dd0-abe9-41d5-aca0-388073f0e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:43.717137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 309/635] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:43.717137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 327/636] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffabf-9fbb-4bb7-a60c-7e2fabaae506 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffabf-9fbb-4bb7-a60c-7e2fabaae506 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffabf-9fbb-4bb7-a60c-7e2fabaae506 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 328/637] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:43.759693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ffabf-9fbb-4bb7-a60c-7e2fabaae506 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:43.854925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c806-90f1-49f5-924e-e14f249cd9bc None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:43.900712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:43.901732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.902015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.902280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.903329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:43.903633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:43.905117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a523d0-3033-4c0f-9a51-bb045a25cbd0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:43.921825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 310/638] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:43.921825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:43.921825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:43.921825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:43.938596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:43.939915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:43.997660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ffabf-9fbb-4bb7-a60c-7e2fabaae506 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.012823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 311/639] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:44.013882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.049241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.050493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.051241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.052038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.069743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.071309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:44.088869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.090313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 329/640] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.092494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.124498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e086-effe-4b73-ac9e-d84cb79b41e0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.157217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.158100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.158368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.158644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.169734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:44.177524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.179417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 312/641] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.201546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eee05-6d5d-4102-b33c-6864d608fb5d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.234210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.235023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.235296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.235550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.242844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.244351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:44.258493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.259649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 330/642] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.261318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.286451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fea2d-e319-4ce8-bd6e-8769450211ef None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.322914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.323754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.324044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.324285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.343713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:44.351802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.352777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 313/643] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.354247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.369783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a349-ec42-4380-8f4e-44c38332633a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.407843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.408519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.408791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.409127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.409793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:44.410095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.411493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.427750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 331/644] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:44.427750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.470911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861989d-2992-4296-a31c-f5d8157f3783 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.508387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.509286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.509697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.510070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.511118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:44.511527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.513642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.529647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 314/645] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:44.529647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.537809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b23a1-360e-4289-843b-cbde2588f04f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.573963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.574640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.574915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.575183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.576057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:44.576366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.577798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.600061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 332/646] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:44.600061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.652728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a34d-9f72-4d31-ac29-ce6ff628377d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.696806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.697390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.697667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.697935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.698668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:44.698971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.700430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.713279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 315/647] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:44.713279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.729736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19595e-64a4-4f23-999b-bbbdee7fd23f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.766556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.767826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.768313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.768798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.776872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.779066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:44.796127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.797249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:44.798282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:44.800349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 333/648] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.801354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.829151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932544-4a3f-47dd-81a0-55ee16c8d6a8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.864307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.865103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.865383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.865661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:44.877382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:44.881160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:44.898610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:44.899803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 316/649] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:44.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:44.917086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e82f-c586-4901-8d8e-0a6f49193c7e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:44.951298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:44.952236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:44.952683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:44.953100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.007539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e5f44-32c4-47a7-922a-0f53492aa9ff None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.022770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.024292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.041970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.042863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.043204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.043603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.064412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.065976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:45.083200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:45.084371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:45.085491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:45.085491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:45.085491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:45.085491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:45.090557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 317/650] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:45.090557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.144742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 334/651] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:45.145733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.212907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eed63-ae5f-4ced-84a8-f8c08a5575cc None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.249870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.250579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b449fa-6ba8-4ef9-b02c-99b5a83c560e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.250807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.251176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.251575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.252529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:45.252917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.254533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.273258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 318/652] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:45.273258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.306325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.307451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.307967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.308443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.309729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:45.310271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.313065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.343396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 335/653] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:45.343396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.392767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1033f46-94d5-456d-adc4-db920786a76c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.433096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.434168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.434629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.435128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.436153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:45.436607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.438239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.450728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 319/654] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:45.451580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.486361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229154da-d7b4-4c94-9909-0d927a696d28 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.530067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.530870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.531147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.531416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.545151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.547260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.567012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760664-6dce-47b6-ac76-c2f49096cfd5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:45.567839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:45.569685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:45.571586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:45.571586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:45.571586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:45.571586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:45.571586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 336/655] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:45.572541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.613768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.614971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.615255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.615529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.616770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:45.617104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.619245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.638144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 320/656] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:45.638144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.705907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca60379-c7c8-4b00-a702-9f48bd6c54b6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.752272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.753512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.753977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.754365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.767538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.771284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:45.797121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:45.799201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 337/657] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:45.801459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.836473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dea0b-b6b3-4692-9b9f-c645d882a793 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:45.901740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:45.903494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:45.904060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:45.904624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:45.924614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:45.927278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:45.951213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:45.953785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 321/658] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:45.955897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:45.957298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd93c5-d48c-415e-b9cd-26712f9d1b2e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.001127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.002883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.002883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.002883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.003480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:46.003891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.005456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0e429-3b22-4607-af12-b578861bef0b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.018357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 338/659] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:46.019899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022dcd2-1691-4218-9e9a-b0b9eae1fef7 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.020271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022dcd2-1691-4218-9e9a-b0b9eae1fef7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.020613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022dcd2-1691-4218-9e9a-b0b9eae1fef7 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.021945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 339/660] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:46.022728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022dcd2-1691-4218-9e9a-b0b9eae1fef7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.106524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6df3-09ec-4740-8286-975384075a39 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.140022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022dcd2-1691-4218-9e9a-b0b9eae1fef7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.157640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.158363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.158684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.158924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.159801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:46.160110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.161649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.187880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 322/661] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 14:36:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:46.188817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.192140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.192822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.193100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.193367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.194210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:46.194514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.195976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270d153-68fd-498e-906c-b79748e14db2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.218875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 340/662] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:46.218875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.218875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.218875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.234581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:46.235802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:46.312565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 341/663] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:46.319090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.347093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed46ba-2e51-4f6c-81a6-5467a1b83200 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.382124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.383128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.383444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.383687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.390573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.392099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:46.405882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:46.407150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 323/664] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:46.408654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.450564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd25f-e484-4c78-93fe-6f16c86be064 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.489692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.490337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.490615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.490881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.530628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950df7f-ab0c-4a49-8b47-91dbcc749d47 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.559960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.561492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.577276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.578093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.578476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.578847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.665832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.668041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.672553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 342/665] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:46.673871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.802833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 324/666] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:46.803775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.805324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daa2e7-660e-43cd-b584-f14d07207c50 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.850511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.851222 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.851493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.851816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.864356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:46.874840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:46.876560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 343/667] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:46.877926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.914777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5991-5cc4-45e2-8af2-e09119fc9ae2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:46.956338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:46.957002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:46.957279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:46.957547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:46.958339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:46.958642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:46.960133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:46.976939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 325/668] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:46.976939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:46.982039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062ca6-f6b4-4d02-bf36-b1365c0f8bd4 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.014583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.015381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.015759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.016036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.028154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.029635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:47.047275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:47.048654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:47.049782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:47.049782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:47.049782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.049782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:47.053008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 344/669] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:47.053788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.075704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa759-0fe2-4189-81d1-cd3fe105520b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.111282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.112031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.112312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.112583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.123169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.124682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:47.142409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:47.143407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:47.144396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:47.144396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:47.144396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.144396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:47.148304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 326/670] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:47.149005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.156933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8ecd-f529-43dc-9fd6-b4d3b1f2cb02 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.194156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.194981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.195269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.195541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.196352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:47.196660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.198178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.207530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 345/671] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:47.208484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.278578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226804f-89a2-4920-b510-22843b7698fa None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.313526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.314245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.314524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.314792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.315626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=3408c447488e472399394fdd26215a8d) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:47.315968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.317459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.330277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051972-10e5-4881-89f6-dd47afa2dc14 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.339967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 327/672] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/role_assignments?user.id=3408c447488e472399394fdd26215a8d&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:47.339967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.388263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.392419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.392704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.392969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.393798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:47.394108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.395538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.425569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 346/673] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:47.425569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.468011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e6b7-26af-4beb-8ef8-7762ff8b08a5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.515237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.516367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.516767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.517236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.518383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:47.518830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.521182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.546407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 328/674] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:47.548312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.581078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693398b-1b31-451a-b3f1-1fa90e4ca594 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.622600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.623873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.624357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.624905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.644638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.648307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:47.678103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:47.679522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:47.680980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:47.680980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:47.680980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:47.680980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:47.681386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 347/675] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:47.683176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.697717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575be4b-2f18-448d-9a21-ef503ea1e666 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.744755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.745835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.746156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.746659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.757476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.759027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:47.777068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:47.778501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:47.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 329/676] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:47.784502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.831374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78af87a-591a-4b47-9352-595302256c21 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.878919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.880071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.880519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.880893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.887985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6495-8e7f-4d15-a6ce-92cd165b898f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:47.890721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.892910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:47.915961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:47.917969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:47.920423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:47.927710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 348/677] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:47.927710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:47.928897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:47.930005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:47.930465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:47.930961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:47.932197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:47.932754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:47.935705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:47.959768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 330/678] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:47.959768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.112601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc660f-94f4-43a7-be82-aeb8bf25bd4f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.112900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44a44-d51f-44e0-ae9c-ae9aa16d4ca6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.166867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.167881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.168262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.168665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.169590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:48.170014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.171598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.174687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.175997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.176182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.176648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.178031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:48.178551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.181199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.196187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 349/679] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:48.198175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.215710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 331/680] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:48.215710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.374619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe46f-7dd5-4b5e-9940-e9e355bc3353 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.390093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d7ee-8fdd-42f8-be09-27a2b2f7aa34 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.412788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.413458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.413737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.414007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.414849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=5cb06fb2f9574061859dc8e25ec44bb2) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:48.415160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.416729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.423815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 332/681] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/role_assignments?user.id=5cb06fb2f9574061859dc8e25ec44bb2&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:48.424688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.446425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.447565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.448035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.448486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.458029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.459996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-cda1440d-9cc3-46df-a43b-2840994259f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:48.477698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:48.478943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:48.480162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:48.482586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 350/682] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:48.484226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49adde-8022-4d4a-b725-9fa4fc85a218 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.484712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49adde-8022-4d4a-b725-9fa4fc85a218 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.485164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49adde-8022-4d4a-b725-9fa4fc85a218 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.487262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 351/683] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:48.490910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49adde-8022-4d4a-b725-9fa4fc85a218 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.629206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81488232-4575-4115-bdec-6a5974c5ca0f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.664808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49adde-8022-4d4a-b725-9fa4fc85a218 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.692883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.692883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.692883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.693500 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.694787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=735bc87032af455c8900fafe88496ba2) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:48.695309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.698459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03fd3-e519-47a9-b6c6-d1105d5c19a0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.709878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 333/684] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/role_assignments?user.id=735bc87032af455c8900fafe88496ba2&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:48.712426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.713011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.713591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.726940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.727641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.728046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.728343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:48.729233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:48.729545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:48.731149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:48.741020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:48.742941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:48.754664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 352/685] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:48.761541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.873302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 334/686] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:48.884900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d8e2-2eef-4696-9be4-86d84e5f2d47 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:48.913762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:48.983567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:48.984185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:48.984467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:48.987700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:49.110338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:49.113081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:49.138133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c272f-d40e-4369-96a5-dd69fc81e471 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:49.206156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:49.209176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:49.209176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:49.209176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:49.235104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:49.249199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:49.251507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:49.253559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 335/687] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:49.261863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:49.283335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 353/688] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:36:49.293536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:49.436672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dfa9-80c5-4852-8c88-a6bbd57440a1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:49.497859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905d88-601c-4e03-a3a6-fd92380cbfba None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:49.503549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:49.504635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:49.505075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:49.505504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:49.506736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:49.507225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:49.509702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:49.540340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 336/689] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:49.546394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:49.566780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:49.568124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:49.568604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:49.569060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:49.597993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:49.600775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:49.665968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:49.668105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:49.670236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:49.670236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:49.670236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:49.670236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:49.678443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 354/690] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:49.689430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:49.741202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d30d-60b4-4a47-8e1e-c886eb8daa40 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:49.776473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:49.778134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:49.779915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:49.781088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:49.804124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:49.807415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:49.834927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:49.835960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:49.836904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:49.836904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:49.836904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:49.836904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:49.852153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 337/691] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:49.855992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:49.942169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213a16-689f-4a70-94ae-6063d2cfb6d9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:49.978857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fa32-b4c8-4a8e-8af4-98a331bc19ad None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.013312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.014376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.014887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.015365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.016352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:50.016875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.018579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.037368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 338/692] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:50.039060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.049088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.050247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.050710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.051161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.052678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:50.053058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.055657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.091703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 355/693] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:50.098008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.144325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eb8e-94ed-4a17-8dcc-8519ab5d1e75 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.179261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.180478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.180956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.181440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.189233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.191001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:50.206204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:50.207245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:50.208238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:50.215358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 339/694] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:50.217086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.311582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6f42-c089-4b05-aac4-53698b7dd964 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.360651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.361584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.361858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.362127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.362447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1087f1-bf7f-4275-8069-1a4d28b70fe6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.370435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.372429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c360630d-2bcf-4c3a-b3e1-bf285a434f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:50.390574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:50.391599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 356/695] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4325f-4a5e-4325-a92b-dbaad3e57216 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.400708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4325f-4a5e-4325-a92b-dbaad3e57216 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.401339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4325f-4a5e-4325-a92b-dbaad3e57216 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.401339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 357/696] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:50.404185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.404782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.406057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.406057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.406280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.406471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.406905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.407362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:50.407702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.409452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.425804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:50.427373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:50.431520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 340/697] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:50.432447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.527699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 358/698] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:50.527699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.632840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94ad8-55dc-454f-a70a-40aa102849f2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.639728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8562-6205-4b8b-a592-b3cbf496d5bb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.682106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.682762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.683036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.683329 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.693573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.695090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.696052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.696868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.698630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:50.699498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.702466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.728447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 341/699] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:50.730417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.757879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.759524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.887519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 359/700] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:50.888360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:50.900408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b581ae-07d5-4437-96af-f838fa439a3d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:50.956017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:50.957886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:50.958694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:50.959472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:50.973553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:50.975418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:50.993734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:50.994733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:50.995710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:50.995710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:50.995710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:50.995710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:51.002962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883aee3-d885-4558-bdf7-e0dc8d56681a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.003299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 342/701] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:51.004617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.045868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.046527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.046802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.047072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.048623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=66ba10ffb7804f6e9a05ae87d2c249c0) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:51.048938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.050787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.060489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 360/702] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:50 2022] GET /identity/v3/role_assignments?user.id=66ba10ffb7804f6e9a05ae87d2c249c0&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:51.061739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.177537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4155-14de-4772-b4d3-78af30d2ae6c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.261352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.262654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.263203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.263739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.286439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.289424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.291621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06337-fc15-4352-9294-b89c0f4d0399 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:51.331410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:51.332527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:51.333474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:51.333474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:51.333474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:51.333474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:51.336525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 343/703] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:51.342283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.380413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.381373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.381373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.381843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.382689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:51.382996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.384548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.403111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 361/704] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:51.404552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.473553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26481f96-eea2-4107-8409-5b794085eab5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.513248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.513981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.514260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.514528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.515272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:51.515571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.517149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea1f9a-c832-43e4-bde8-e89ce3a4a5ee None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.535524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb468f4-bfb4-47ef-a384-4ae4456e2302 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.535763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 344/705] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:51.535763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f38a2-da1f-4f2a-9937-ccc983ae6b08 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.535763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f38a2-da1f-4f2a-9937-ccc983ae6b08 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.535763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f38a2-da1f-4f2a-9937-ccc983ae6b08 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.536844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 345/706] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:51.545240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f38a2-da1f-4f2a-9937-ccc983ae6b08 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.573736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.574641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.575290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.575576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.576633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.578728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b8620-68b5-4db0-8b2d-5b1e9eb88add None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.603876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 362/707] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:36:51 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:51.605638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08358d-f830-4f07-878c-0e869849f354 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.605932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08358d-f830-4f07-878c-0e869849f354 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.606213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08358d-f830-4f07-878c-0e869849f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.653428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-dc08358d-f830-4f07-878c-0e869849f354 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:51.654677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-dc08358d-f830-4f07-878c-0e869849f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:51.718046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f38a2-da1f-4f2a-9937-ccc983ae6b08 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.787776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.788533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.788811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.789077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.793380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 363/708] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:51.799450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:51.801273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:51.816822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:51.817823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:51.819659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 346/709] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:51.824841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.825261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201043cb-7752-4359-9896-62bc4509cc5c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.825542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201043cb-7752-4359-9896-62bc4509cc5c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.825929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201043cb-7752-4359-9896-62bc4509cc5c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.827791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 364/710] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:51.836553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898931-d355-4560-9856-c959011530ff None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:51.836878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898931-d355-4560-9856-c959011530ff None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:51.837196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898931-d355-4560-9856-c959011530ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:51.858629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-18898931-d355-4560-9856-c959011530ff None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:51.859861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-18898931-d355-4560-9856-c959011530ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:51.957423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 365/711] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:51.957726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f89-1a42-49b9-8899-0f8c7c986bc1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:51.958293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18898931-d355-4560-9856-c959011530ff None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:51.998387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:51.999203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.000351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.000629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.001562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.001871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.003419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.021503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 347/712] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:52.022599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.079100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18898931-d355-4560-9856-c959011530ff None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.117510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.118339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.118612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.118876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.119536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.120971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:52.135310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:52.137642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:52.139507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 366/713] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 14:36:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:52.141485 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.141636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788bcd8-066a-4721-bd5e-6f0b26ff0b75 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.176046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.176859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.177140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.177419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] PATH_INFO: `/v3/services/network` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.178081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.179577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:52.194231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:52.196761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:52.198736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 348/714] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:52.201928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.250592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92360-0181-4c36-9d90-84a22f010629 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.285241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.285901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.286175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.286443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.287279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.287623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.289109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.304055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 367/715] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:52.305713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.321499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74f5d5-dcfa-4af3-a370-5cc145d6cb9a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.361550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.362665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.363114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.363611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.364585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.365115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.366766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.372777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 349/716] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:52.379871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.477206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a24b-0db3-4cea-a720-d8a414b4b472 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.518324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.519271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.520056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.520497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.521383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] RBAC: Adding query filter params (name=network) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.522027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.524144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.530609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 368/717] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:52.537205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:52.589996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e33e4-90cc-4085-bdce-dae26cf947ea None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.636706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.637843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.638420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.638916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.639933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.640456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.642214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae8a58-38dc-4334-b3a4-e9c687e597b9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.649395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 350/718] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:52.694665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9279f-ae73-4c82-af06-92864c9b6fc9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:52.739116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:52.739835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:52.740118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:52.740393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:52.741127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] RBAC: Adding query filter params (type=network) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:52.741433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:52.742825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b49b-c6ef-493e-b7ea-9f62a8fa9af0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:52.749643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 369/719] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:36:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:54.042036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52394-4410-4e30-bc79-268792c7f7e1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.042615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52394-4410-4e30-bc79-268792c7f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.042615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52394-4410-4e30-bc79-268792c7f7e1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.044342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 351/720] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:54.049584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.050075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.050182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.076729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:54.077952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:54.162289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 370/721] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 14:36:54.201388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52394-4410-4e30-bc79-268792c7f7e1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.345503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52394-4410-4e30-bc79-268792c7f7e1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:54.393865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:54.394713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.394990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.395252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.411787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-df37b6e0-0ab8-401d-8d5b-3c3ca410aa02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:54.421746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:54.422854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:54.428301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:54.430609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 352/722] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:54.436726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.524643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca33-f623-43c7-8901-e4380b4f8f34 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.525004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca33-f623-43c7-8901-e4380b4f8f34 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.525278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca33-f623-43c7-8901-e4380b4f8f34 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.527390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 353/723] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:54.535723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.536028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.536467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.540569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf429e-dd44-4fcb-9e6a-327afc188621 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:54.560024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:54.561226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:54.589547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:54.590234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.590504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.590771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.591534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:54.591872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:54.593357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:54.612184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 371/724] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:54.617101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.689591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 354/725] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:54.735029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b232c-449e-43b6-ae5a-a79680976f5b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:54.759223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.771906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:54.772738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.773033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.773437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.786662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:54.788195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:54.810805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:54.811849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:54.812818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:54.812818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:54.812818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:54.812818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:54.812818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 372/726] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:54.824792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.895520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0e8a9-84fd-4cc3-90b7-55bff5627486 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:54.928992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f6a2-0267-4da5-a48c-47b7d1d8d7a5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:54.941812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:54.942633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.942910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.943184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.964874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:54.965247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:54.965566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:54.965847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:54.966120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:54.966853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:54.967159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:54.968635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:54.981529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 373/727] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:54.983122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:54.984145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:54.985033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 355/728] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:54.995850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:54.996037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.121001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292a88-eb08-4527-8220-f65cab445f14 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.145204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b9e6-47be-4f56-9a8a-8eedd9e4f887 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.163377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.164141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.164424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.164699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.178651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.180360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.180628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.181053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.181326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.181590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.182348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:55.182645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.184102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.193654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 374/729] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:55.200749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:55.205908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:55.208054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:55.210285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 356/730] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:55.215696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.349960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8ed40-485a-4f5c-a880-33bfb2e8dab0 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.397031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb4d4f-b461-4ca5-8aeb-515c79da8683 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.407708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.408406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.408687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.408961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.409823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:55.410129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.411654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.440209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 357/731] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:55.441657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.442493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.442759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.443025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.445730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.455175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.456708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:55.474806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:55.475872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:55.476781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:55.476781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:55.476781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:55.476781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:55.476781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 375/732] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:55.484154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.559607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1128c8-d40c-426d-aaca-890813772c7c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.596258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.597215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.597496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.597767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.611378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf6c7-9b72-414f-ad30-43610b2bfedf None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.648698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.649368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.649644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.649913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.650631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:55.650931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.652529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c76c0-0719-428a-aae0-21ac845469a2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.665655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 376/733] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:55.667015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e940-c122-4784-b76d-9195f1003c75 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.667296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e940-c122-4784-b76d-9195f1003c75 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.667564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e940-c122-4784-b76d-9195f1003c75 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.669229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 377/734] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:55.671031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e940-c122-4784-b76d-9195f1003c75 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.694997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.699064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a97b1-5b79-46d1-b01f-4ce5e578f592 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.809368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e940-c122-4784-b76d-9195f1003c75 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:55.846673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 358/735] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 14:36:55.848046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d35e7-3143-4411-a431-6fb01c5e7833 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.848329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d35e7-3143-4411-a431-6fb01c5e7833 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.848603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d35e7-3143-4411-a431-6fb01c5e7833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.857707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:55.859046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.859482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.859972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.868963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6c9d35e7-3143-4411-a431-6fb01c5e7833 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:55.870169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6c9d35e7-3143-4411-a431-6fb01c5e7833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:55.874906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:55.877732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-2b5d83db-dd3e-4349-9e3a-ce71cd568af6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:55.896729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:55.897762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:55.898698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 378/736] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:55.901270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6bc1e-4d8d-4528-943e-68b0bf178538 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.901736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6bc1e-4d8d-4528-943e-68b0bf178538 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.902188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6bc1e-4d8d-4528-943e-68b0bf178538 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.905225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 379/737] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:55.906538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6bc1e-4d8d-4528-943e-68b0bf178538 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:55.964072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 359/738] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:55.965383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c259-3eae-40a9-9702-354b0c931ae8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:55.965668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c259-3eae-40a9-9702-354b0c931ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:55.965933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c259-3eae-40a9-9702-354b0c931ae8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:55.967749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 360/739] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:36:55.968439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c259-3eae-40a9-9702-354b0c931ae8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.020983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6bc1e-4d8d-4528-943e-68b0bf178538 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.057629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.058410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.058684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.058948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.078965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.079557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c259-3eae-40a9-9702-354b0c931ae8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.080690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-48a75564-b1ff-4c89-9cf8-f7ea3f665441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:56.100970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:56.102176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 380/740] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.104815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.118886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.119591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.119907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.120186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.121026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:56.121328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.122796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:56.122939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd1d0-2d0c-485b-a2a0-6177a3f1ae2e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.124079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:56.143150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 361/741] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:36:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:56.144662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.144943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.145244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.163951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:36:56.165182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:36:56.196216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 381/742] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:56.197521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.263783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 362/743] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 14:36:56.263783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.296914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0cc98-1274-4185-9e1a-68a8cccec80d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.332305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.333183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.333462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.333732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.349041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:36:56.364822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:56.365987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:36:56.366874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:56.367581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 382/744] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:56.368376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.377436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc247675-d0f1-4b17-9020-97d6fda1cd9f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.413049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.413808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.414080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.414345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.415068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:56.415414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.416893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.429297 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 363/745] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:56.429860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.497117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362819d-e5da-414d-a848-0a4575f01ba9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.536826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.537727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.538165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.538534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.547741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1bf9-b28f-4a82-a926-6c5858e1a0c7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.584668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.585340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.585616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.585882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.586608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.588064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.605262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 364/746] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:36:56 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:56.606159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.616870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.618402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.761818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 383/747] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 14:36:56.761818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.777362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb459e8-3675-4040-b1a8-1ef6e9efe4d8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.824330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.825305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.826321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.826321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.827161 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.829390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.844796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 365/748] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:36:56 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:36:56.846062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:56.917873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56de8b-3a91-4ff6-91e9-cd5e5f2f7595 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:56.966275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:56.967564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:56.968089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:56.968549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:56.969652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:56.970445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:56.972305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:56.983623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 384/749] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:56.984938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.002218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951922-9ac5-41f1-8a9d-358d5c7c3bee None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.042011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.043210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.043509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.043813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.054045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.055872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:57.071853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:57.072829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:57.073767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:57.077999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 366/750] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:57.078864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.099643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5ecb-d300-468f-82ad-3f52fe02b7ea None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.134981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.136230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.136730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.137194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.149689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.151531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:57.170327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:57.171344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:57.172281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:57.172281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:57.172281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:57.172281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:57.174740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 385/751] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:57.175901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.183980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16459b-14db-49b4-ad9d-a16e84cdccd5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.218678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.219508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.219822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.220138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.230924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.232576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:57.250759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:57.251810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:57.252732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:57.252732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:57.252732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:57.252732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:57.252732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 367/752] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:57.253460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.284804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4063-e226-4aea-9c11-c903daced476 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.328680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.329391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.329688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.329959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.331270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:57.331582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.336646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.355758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 386/753] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:57.357043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.392679 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41e5d-f478-4cda-90a5-0d1864784772 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.437300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.437993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.438311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.438537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.439351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:57.439656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.442276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.455970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 368/754] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:57.456918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.492240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5481a7-412c-49fc-bbd4-955687ef9ed2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.558644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.560529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.561403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.562171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.563818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:57.564806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.567763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.587569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117f756-8fa7-4f8b-9d5d-e8fabfe5a40f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.591573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 387/755] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:57.593532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.624245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.624995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.625272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.625597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.626575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=66ba10ffb7804f6e9a05ae87d2c249c0) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:57.626931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.628555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.644051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 369/756] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/role_assignments?user.id=66ba10ffb7804f6e9a05ae87d2c249c0&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:57.645218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.783531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d874e-90a3-44f8-a0c1-52c729266ebd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.785269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef80a8-2179-4844-83be-9dbb8bdf4e1e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:57.822858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.824072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.824072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.824372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.851347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:57.853465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:57.854398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:57.855472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:57.870065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.873379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:57.903831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:57.905459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:57.907224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:57.916292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 388/757] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:57.922313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:57.966122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:57.967698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:36:57.983112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:57.985073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:57.987066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 370/758] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:57.998021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:58.134314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f115d-9b6c-4eff-b751-b0b24dc53152 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.149390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb6e6-6b97-457f-b81b-1c039370e27d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.208955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.210122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.210622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.210921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.215705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:58.215705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.215705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.219822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.221011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.221472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.221927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.223389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:58.223940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.226577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.267930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 389/759] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:58.272181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 371/760] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:36:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:36:58.273331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:58.280973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:58.441598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6b4e-3772-430e-a862-28fb708308a1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.502969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.503798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.504099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.504329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.518359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.519888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.526812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4672afb-ca16-4425-98fa-74583fae1dc7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:36:58.551245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:58.553092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:58.554887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:36:58.554887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:36:58.554887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:36:58.554887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:36:58.554887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 372/761] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:58.562794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:58.594050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.594712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.595025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.595307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.596154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=9a66dd362d8f445f9c8f4027c4bd4f6c) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:58.596463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.597895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.610110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 390/762] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:36:58 2022] GET /identity/v3/role_assignments?user.id=9a66dd362d8f445f9c8f4027c4bd4f6c&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:58.717678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd581a-9f67-40d6-b648-a10c129c5736 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.771399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.772138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.772420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.772699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.773465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:58.773767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.775367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.793673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 373/763] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:58.803836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:58.931050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d65e-2f09-4aff-954f-96e75a5f853b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:58.966510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:58.967337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:58.967610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:58.968007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:58.975584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:58.977182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:36:58.992614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:36:58.993659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:36:58.994582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 391/764] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:36:59.003628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:59.175496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495de1-b930-445e-a2b6-1e8244c942d8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:59.230164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:59.231178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:59.231635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:59.232123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:59.235536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:36:59.240835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:59.243982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068fa9e-8a9d-4b12-aedc-386cb91c9432 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:59.266257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 374/765] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:36:59.272084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:36:59.455141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dccac6-2d83-49a1-a0cd-4a9e755856d0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:36:59.512481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:36:59.513904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:36:59.514365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:36:59.514818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:36:59.518188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=d9052eeac18b49d79f81f1a3ec919c61, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:36:59.520827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21b7f-a3c8-487d-bf3f-c394e05b93f1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:36:59.548157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 392/766] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:36:59 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:00.072200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4089a7-53fd-457a-9bdc-13d91c3d9311 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.072476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4089a7-53fd-457a-9bdc-13d91c3d9311 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.072933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4089a7-53fd-457a-9bdc-13d91c3d9311 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.074499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 375/767] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:00.079573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f4-386a-404b-a140-5dfdae549ae0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.079932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f4-386a-404b-a140-5dfdae549ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.080182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f4-386a-404b-a140-5dfdae549ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.100777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b45ba8f4-386a-404b-a140-5dfdae549ae0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:00.102017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b45ba8f4-386a-404b-a140-5dfdae549ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:00.179407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 393/768] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:00.203136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4089a7-53fd-457a-9bdc-13d91c3d9311 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:00.221664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c7798-2b9c-4ebd-85a7-13e782d16db0 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.222346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c7798-2b9c-4ebd-85a7-13e782d16db0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.222823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c7798-2b9c-4ebd-85a7-13e782d16db0 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.224508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 394/769] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:00.232613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.233199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.233684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.269524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:00.272878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:00.396262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 395/770] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:00.416435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4089a7-53fd-457a-9bdc-13d91c3d9311 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:00.437419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:00.491306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:00.493262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.494059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.494847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] PATH_INFO: `/v3/services/network` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.496405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:00.499684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:00.541839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:00.543900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:00.545611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:00.551104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 376/771] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services/network => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:00.561468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:00.641317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f87a-a90e-427d-b3a5-0ac9d11fe564 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:00.690680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:00.691497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.691801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.692069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.692730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:00.694126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:00.714400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:00.716293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:00.717986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 396/772] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:00.736205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:00.785042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38ead9-24af-4521-8e55-9f0fe0b19f7e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:00.853984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716da0-a575-49be-9445-474e55a52099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:00.855614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716da0-a575-49be-9445-474e55a52099 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.856423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716da0-a575-49be-9445-474e55a52099 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.857217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716da0-a575-49be-9445-474e55a52099 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.858848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716da0-a575-49be-9445-474e55a52099 None admin] RBAC: Adding query filter params (name=network) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:00.859657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716da0-a575-49be-9445-474e55a52099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:00.862729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716da0-a575-49be-9445-474e55a52099 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:00.871739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753e85-187a-4842-aa12-aea76ec91fec None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:00.879949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 377/773] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:00.895170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716da0-a575-49be-9445-474e55a52099 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:00.920451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:00.920736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.920913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.921265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.922838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:00.923306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:00.924752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bad5-7e40-442f-89a1-7f3b0ee0a3f5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:00.929654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 397/774] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:00.931135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b83fe-2e55-4046-a4d4-266997ccc434 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:00.931467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b83fe-2e55-4046-a4d4-266997ccc434 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:00.931771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b83fe-2e55-4046-a4d4-266997ccc434 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:00.933357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 398/775] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:00.935095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b83fe-2e55-4046-a4d4-266997ccc434 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.041233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716da0-a575-49be-9445-474e55a52099 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.063808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b83fe-2e55-4046-a4d4-266997ccc434 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.088001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.089309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.089693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.090304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.091274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] RBAC: Adding query filter params (type=network) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:01.091690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.093752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e834251-02a2-4ed5-8321-de21cf752585 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.100094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 378/776] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:01.101518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.101918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.102285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.111283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.112420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.112910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.113397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.114748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:01.115294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.117976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.121140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:01.122807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:01.132023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 399/777] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:37:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:01.133619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.252487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 379/778] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:01.254716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.290006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61542-1fad-4d9e-b253-dbf6a4360fc5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.343562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.344526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.345047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.345464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.346433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] RBAC: Adding query filter params (interface=public, service_id=96164922fbee4ef893e63a4ac216994b, region_id=RegionOne) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:01.346901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.348487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.357213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 400/779] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/endpoints?service_id=96164922fbee4ef893e63a4ac216994b&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:01.358275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.474646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220cb44-ed08-490f-807e-7cf40b562b45 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.488554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12593a-c08a-4834-bcb7-d778764c2f52 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.515116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.517210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.517713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.518181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.531837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:01.542168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:01.543243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:01.544139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:01.551482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 401/780] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:01.551482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.561101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.562099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.562509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.562920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.564344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] RBAC: Adding query filter params (interface=public, service_id=58c8537d9ae248a0918e2050d1503220, region_id=RegionOne) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:01.564812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.567316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.580307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 380/781] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/endpoints?service_id=58c8537d9ae248a0918e2050d1503220&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:01.581833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.713798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40523d1-6a40-4f14-bd24-8469b0f2bbb3 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.722716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80029f7f-9fac-4aa2-8816-e94da064ca6e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:01.757883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.759845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.760597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.761092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.762986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:01.763549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.767366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.783295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:01.784421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:01.784907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:01.785375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:01.790724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:01.790877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 381/782] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:01.790877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.793053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:01.801248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 402/783] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:01.802490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:01.978978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07a70-fdb2-4fca-8aa3-bd2b4ce9e56a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.019068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.019845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.020127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.020398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.025862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e104a-f225-4ecd-96a8-707b70088694 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.041478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.044539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.064144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.064817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.065097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.065361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.066054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.067477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b6ae2-2888-4aeb-b7c3-4007a03dbd55 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.073722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 382/784] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/services => generated 772 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:02.075121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad995-c7ed-46bc-a8ed-ab18e5f53e0c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.075407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad995-c7ed-46bc-a8ed-ab18e5f53e0c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.075893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad995-c7ed-46bc-a8ed-ab18e5f53e0c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.077932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 383/785] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:02.080079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:02.081001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:02.082322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:02.082322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:02.082322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:02.082322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:02.083930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 403/786] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:02.085113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.085398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.085674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.097505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.106402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:02.107058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:02.254085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 384/787] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:02.288145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7a06-9447-4a33-a026-1ea8cf8d1eeb None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.300681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.343776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.344872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.345369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.348937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.350995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:02.352471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.353897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.371633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 404/788] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:02.376235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.510472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceb1ba-1473-4043-b7cd-1aa5a47ea23e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.569384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6debcd0-f57c-4fd0-9658-dad45d0420b6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.580019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.581861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.582556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.583204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.602292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:02.608091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.609042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.609419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.609786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.618038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.619693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-57af3998-3957-49ec-bbd6-6607a3911746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:02.620057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:02.622008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:37:02.623920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:02.635818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 385/789] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:02.638552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027158-1e9c-4fef-bf28-52f12c015030 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:02.639244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:02.641250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:02.643982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 405/790] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:02.645824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027158-1e9c-4fef-bf28-52f12c015030 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.646651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027158-1e9c-4fef-bf28-52f12c015030 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.648967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.650141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 386/791] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:02.652064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027158-1e9c-4fef-bf28-52f12c015030 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.781453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5fd7-8a79-4e89-bb5d-8c97975bde44 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.827368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.828091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.828432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.828763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.829753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:02.830276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.832420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d82b5-5245-4e1c-af18-5ac69256666d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.847703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027158-1e9c-4fef-bf28-52f12c015030 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:02.859772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 406/792] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:02.861451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.861750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.862032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.887912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:02.890202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:02.908777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:02.910389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:02.911177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:02.912012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:02.913724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:02.914581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:02.917735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:02.940007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 387/793] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:02.942066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:02.978628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 407/794] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:02.979599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.129233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5023f-f2e4-4447-834c-b5e4254722ce None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.143028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8e7c0-72d6-4fdf-a01d-857676e56695 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.166860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.168818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.169351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.169856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.185111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.186962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.188313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.189321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.189779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.190206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.206326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:03.208202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.209366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.210501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:03.210501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:03.210501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.210501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:03.210814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.212210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 388/795] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.213211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:03.235645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.236856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.237938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:03.237938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:03.237938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.237938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:03.239941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 408/796] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.241048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.336996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2c88-d38b-4b98-9a5d-212ae4d1a21e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.356334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451a2-40ec-4a2c-84d9-d38048bbe4b9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.383114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.383896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.384345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.384625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.396025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.396858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.397244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.397622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.398239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:03.398568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:03.398991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.400517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:03.406881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.408082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:03.409195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 389/797] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.410041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.415911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 409/798] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:03.416789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.519118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0fc56-9db3-4f6c-9040-e2dfc2cf5b34 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.537591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab515-7584-4bd7-bca2-12cd3771b9f4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.564436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.565285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.565787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.566065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.566833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:03.567138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.568553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.577620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.578308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.578555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.578828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.579653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:03.579976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.581380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.581825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 410/799] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:03.583166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.595380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 390/800] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:03.596392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.696856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7d21-8167-4f3a-97c1-a4e109e31b12 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.719812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe33ca-8a64-43ca-98e6-0d1287877329 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.729867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.730684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.730965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.731235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.738376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.739978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:03.755345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.756371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:03.757267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 411/801] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.759170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.764248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.765405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.765889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.766361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.781807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.784453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:03.811326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.812322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.813233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:03.813233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:03.813233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:03.813233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:03.816058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 391/802] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.817206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.862113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0e-cb14-444e-b13f-384153d24799 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.896593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.897599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.897986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.898655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.906578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.908301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.922073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b99-b5de-4e8a-9aa7-4c48e0c663e7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:03.924442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:03.925604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:03.926571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:03.927211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 412/803] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:03.928962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:03.960315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:03.961216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:03.961657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:03.962070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:03.963003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:03.963451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:03.965075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:03.977523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 392/804] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:03.978655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.034444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bfe48-ec95-45d4-b6d7-366751a654c3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.069872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.070746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.071173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.071580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.072438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:04.072849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.074387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.079947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91e2b-7951-4b7d-af44-66365fade676 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.087486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 413/805] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:04.088371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.114783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.115755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.116207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.116624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.117625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:04.118075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.119703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.138902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 393/806] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:37:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:04.140233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.200924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa6d-3c77-4d31-8d85-9db260d94bc8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.236845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.237777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.238062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.238337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/66ba10ffb7804f6e9a05ae87d2c249c0/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.240384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=66ba10ffb7804f6e9a05ae87d2c249c0, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.241825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.250070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3326-7f65-4cf4-96b9-843b64469e58 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.261031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 414/807] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:04 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/66ba10ffb7804f6e9a05ae87d2c249c0/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:04.262042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.287259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.288506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.289031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.289559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.298246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.300136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:04.315471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:04.316545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:04.317505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:04.321397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 394/808] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:04.332769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.386586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dd1-59fe-497f-b429-05875fe8c268 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.425516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.426487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.426780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.427056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.441377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.442746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d6d769fa-27c3-428f-bb90-924ab5df7843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:04.465625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:04.466616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:04.467559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:04.467559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:04.467559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:04.467559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:04.474229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 415/809] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:04.474229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eba9d-964a-47b9-957a-09791cf7d7bd None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.474229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eba9d-964a-47b9-957a-09791cf7d7bd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.474229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eba9d-964a-47b9-957a-09791cf7d7bd None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.474229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 416/810] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:04.480795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eba9d-964a-47b9-957a-09791cf7d7bd None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.498306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51012-26ea-400d-871c-1a8b277f4729 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.549770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.550617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.550851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.551127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.552302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:04.552625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.555147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937caaa-d23e-4840-8c52-31c870858d56 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.583141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 395/811] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:04.585145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.585445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.585694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.607600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:04.609106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:04.611585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eba9d-964a-47b9-957a-09791cf7d7bd None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.647763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.648968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.649463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.649984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.651038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:04.651578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.653677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.666994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 417/812] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:04.672998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.689464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 396/813] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:04.695830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.798289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0be56-e6a8-4b2e-96e1-f13c93a1c285 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.800878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df3e30-37ea-42d6-b3e2-bfd2b260d7b8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:04.831842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.832500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.832779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.833070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.836181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:04.837147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:04.837574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:04.838077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:04.845150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.846824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:04.860913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:04.862026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:04.863184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:04.865093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 397/814] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:04.866008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:04.908618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:04.910086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a96032-8312-4dd8-a6c8-453f7a07d265 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:04.970638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fcae-f1e3-4143-b697-6982dc185a2b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.004908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.005712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.005988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.006456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 418/815] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:05.007768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c615-397f-4098-980f-d1a71e5f2606 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.008015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c615-397f-4098-980f-d1a71e5f2606 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.008288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c615-397f-4098-980f-d1a71e5f2606 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.009707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 419/816] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:05.010269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c615-397f-4098-980f-d1a71e5f2606 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.011888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.012649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.014169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:05.029757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:05.030860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:05.031799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 398/817] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:04 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:05.034332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.120283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c615-397f-4098-980f-d1a71e5f2606 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.131911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aeef5-28fd-483a-92cc-51f89e9419f6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.156376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.157665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.158137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.158613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.159655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:05.160145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.161882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0546-da12-45a5-9f50-e79ae44bdb3b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.166642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.167487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.167810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.168076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.176633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 420/818] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:05.178287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.178722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.179128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.190482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.192053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.197990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:05.199272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:05.211416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:05.212481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:05.213450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:05.213450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:05.213450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:05.213450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:05.213450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 399/819] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:05.213738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.278154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 421/820] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:05.279441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.335148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b45a5-2b0e-4249-a922-ec640eb14187 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.368315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.369020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.369310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.369590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.370378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] RBAC: Adding query filter params (name=network) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:05.370628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.372137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.382122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 400/821] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:05.382122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.392546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d643-10cf-4aae-8203-89f6e478bf70 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.427945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.429023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.429353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.429625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/9a66dd362d8f445f9c8f4027c4bd4f6c/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.445351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=9a66dd362d8f445f9c8f4027c4bd4f6c, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.446833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.460996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 422/822] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:05 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/9a66dd362d8f445f9c8f4027c4bd4f6c/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:05.461860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.506855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c2f2-202c-4857-b4b5-d35de65b26cc None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.546672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.547365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.547643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.548045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.548836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:05.549140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.550634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.569799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 401/823] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:05.570819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.614187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374beb6d-9d2e-4642-b262-71428f3b9d9f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.660461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.661387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.661670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.662803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.662803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.664037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:05.679020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:05.680251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:05.681113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 423/824] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:05.681982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.711812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cac5a-35bc-45ad-b66e-4c0c12bfd83e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.761720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.762405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.762687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.762961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.763699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] RBAC: Adding query filter params (type=network) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:05.764013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.765436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.775269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 402/825] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:05.776227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.807414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6033-122c-4d3e-a752-f43fe713bddd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.848523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.849377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.849657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.849931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.857755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.859289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:05.874836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:05.875855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:05.876929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 424/826] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:05.877537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:05.904187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079d1-8a21-4645-a5a8-0e7430d12fec None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:05.949816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:05.950523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:05.950801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:05.951072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:05.951913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:05.952231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:05.953691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:05.959582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 403/827] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:05.960602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:06.010410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4e46-b827-46f7-bc24-51d932f35a67 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.044897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.045616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.045899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.046173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.046929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:06.048394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:06.064575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9023b-1f12-46b8-81ab-752a13cf59aa None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.070554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 425/828] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:06.071410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:06.153552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.154303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.154587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.155015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.155925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:06.156243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:06.157772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:06.180809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 404/829] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:06.185862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:06.231425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256cdf5-99bc-44a3-8397-c6b87713eeeb None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.269030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.269725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.270006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.270281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.271012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:06.271319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:06.272774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:06.279078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 426/830] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 14:37:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:06.288777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:06.344280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fa4-0a76-4ebf-a26a-5227b68c2da6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.382739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.383829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.384347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.384830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.385898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:06.386444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:06.396459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965eb8e-77b9-42e6-9464-e9f835273c00 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:06.407419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 405/831] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:06 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:06.447536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e45d7-a2d2-45e0-8ca2-8b373cd302dd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.488491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.489601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.490084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.490576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.491963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:06.493745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6836b7-bb40-48be-ba26-4f54dbf56603 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:06.521369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 427/832] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:06.724497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703bbf2-d571-4d85-88a8-33b24e474a91 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.725054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703bbf2-d571-4d85-88a8-33b24e474a91 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.725054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703bbf2-d571-4d85-88a8-33b24e474a91 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.726759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 406/833] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:06.732824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.733140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.733376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:06.752525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:06.753668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:06.835343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 428/834] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:06.858723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703bbf2-d571-4d85-88a8-33b24e474a91 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:06.962673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703bbf2-d571-4d85-88a8-33b24e474a91 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:06.997627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:06.998812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:06.999305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:06.999912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.011856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:07.019699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:07.020656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:07.021517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:07.024338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 407/835] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:07.030281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.131355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc08d3a-c85e-4b0e-a684-fb3b6900ae44 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.166032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:07.166710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.166992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.167266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.168056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:07.168366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:07.169833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:07.178793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 429/836] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:07.184269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.285437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce2fc-868b-4cf8-a5a2-d50b678f463a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.319603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:07.324426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.324426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.324426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.335938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:07.339688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:07.354964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:07.355989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:07.357373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:07.357373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:07.357373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:07.357373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:07.357373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 408/837] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:07.362584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.468002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5a1cd-c8cf-400f-b9cc-cdeb3e0dde90 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.501626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:07.502299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.502580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.502851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.503580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:07.503915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:07.505298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:07.521702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 430/838] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:07.526944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.630994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f538f94-49d4-43dc-99d5-eb618c73b48b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.665883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:07.666691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.666968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.667239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.675295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:07.676797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:07.690933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:07.693223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:07.695587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 409/839] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:07.699454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.811748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a066bb-b122-4bd0-94be-2b006d9ae2d3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.847085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:07.847857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.848148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.848464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.849386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:07.849695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:07.851239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc228f7-97ca-43b7-866d-1fc8dc72d56a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:07.874595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 431/840] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:07.880013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:07.970362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e52e4a-3cce-4545-8d8e-d3a66ebb292a None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.970362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e52e4a-3cce-4545-8d8e-d3a66ebb292a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.970362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e52e4a-3cce-4545-8d8e-d3a66ebb292a None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.972686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 432/841] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:07.977399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:07.977963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:07.978472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:07.982431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d14f9-b5c8-4eba-845c-2d29db0b9de5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:07.995875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:07.997457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:08.020683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.021406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.021693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.021965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.077538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 433/842] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:08.101503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.102465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.103064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.211851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a13d7-dc6b-4f1d-b5b2-2891c0e77adc None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.230879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 410/843] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:08.237141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.253842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.255237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.255447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.255723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.267069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:08.274878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:08.275877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:37:08.277208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:08.281322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 434/844] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:08.283177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.351726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7346-9c21-4c1a-8b5b-bb275cb728a6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.388577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da972370-4230-48b8-8920-4e2edb2e3a0d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.390380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.391311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.391887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.392249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.403451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.405118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:08.423104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:08.424228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:08.425125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:08.425125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:08.425125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:08.425125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:08.425362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.425362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.425362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.425362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.425642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:08.425712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.431561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.431818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 411/845] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:08.431818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.441138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 435/846] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:08.442245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.531602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199d20f-cc27-4de5-971f-860de960865b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.545084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5ab-8032-40c1-9df0-f88bb8b1e2c7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.566289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.566956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.567231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.567502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.568266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:08.568562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.569958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.579749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.580611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.580883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.581149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.586223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 412/847] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:08.587625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.592949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.594509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:08.612927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:08.615061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:08.617239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:08.617239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:08.617239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:08.617239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:08.623955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 436/848] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:08.626032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.708009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed4cc1-555c-4bbf-9256-38d089fd2a5f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.750598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d218a9-72f4-44b1-813f-c8ab21002e27 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.751867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.752745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.753020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.753284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.760655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.762223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:08.776997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:08.779566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:08.781745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:08.785031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 413/849] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:08.785198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.789944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.790995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.791497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.792007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.793077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:08.793766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.796569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.821107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 437/850] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:08.823700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.909003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5851e-8ae4-410f-a7a0-d9b02edde0a1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.936398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79cd4-d10a-4cb6-8697-5ed02a80f5ef None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:08.946210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.946874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.947159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.947432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.948266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:08.948572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.950042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42305-deb0-45df-b1cf-aa52bbf6bec3 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:08.962351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 414/851] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:08.963869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37629ef-6cf8-44a8-9fc5-b9b047248749 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.964232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37629ef-6cf8-44a8-9fc5-b9b047248749 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.964581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37629ef-6cf8-44a8-9fc5-b9b047248749 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.966111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 415/852] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:08.970682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37629ef-6cf8-44a8-9fc5-b9b047248749 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:08.975992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:08.976829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:08.977107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:08.977377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:08.985421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:08.986835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-735a94b4-0bf0-476e-b5e7-d0c67f8fae96 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:09.002655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:09.004081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:09.005399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:09.007845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 438/853] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:09.009362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8842d-30e9-4c21-b5c7-41362e6c6a98 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.009642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8842d-30e9-4c21-b5c7-41362e6c6a98 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.009939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8842d-30e9-4c21-b5c7-41362e6c6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.027524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-54b8842d-30e9-4c21-b5c7-41362e6c6a98 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:09.029120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-54b8842d-30e9-4c21-b5c7-41362e6c6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:09.086023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37629ef-6cf8-44a8-9fc5-b9b047248749 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.106187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 439/854] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:09.107532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8f88a-5afd-4c18-ba5e-91d8217d9304 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.107867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8f88a-5afd-4c18-ba5e-91d8217d9304 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.108153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8f88a-5afd-4c18-ba5e-91d8217d9304 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.112318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 440/855] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:09.112318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8f88a-5afd-4c18-ba5e-91d8217d9304 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.128269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.128937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.129227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.129505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.130340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=66ba10ffb7804f6e9a05ae87d2c249c0) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:09.130648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.132178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9abea-34fd-4dfb-a193-c2a7e4e91156 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.138972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 416/856] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:08 2022] GET /identity/v3/role_assignments?user.id=66ba10ffb7804f6e9a05ae87d2c249c0&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:09.140457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.140819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.141218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.161969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:09.163227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:09.237959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8f88a-5afd-4c18-ba5e-91d8217d9304 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.247746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 417/857] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:09.247746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.288416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.289750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.289750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.289750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.290734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:09.291118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.292764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.312758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 441/858] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:09.313579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.363978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d2d39-644b-4e41-b1bf-ab9e1ba5f7fe None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.402587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.403776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.404077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.404348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.405026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.406473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:09.422510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:09.424543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:09.425421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 418/859] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:09.426300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.459099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b27af-da8e-4cde-99cf-908e39893c75 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.503977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.505384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.505678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.505952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.506926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.509466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:09.524904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:09.526006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:09.527655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 442/860] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:09.528904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.544970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc202f3-964b-4bf6-bd5d-5a990f3708cd None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.581232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.581932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.582217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.582491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.641187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15c90-e9e4-4c61-ac5f-60e61bf4ddfd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.661456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.662985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.678040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.678716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.678989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.679259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.680012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:09.680313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.681730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.691308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 443/861] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:09.691308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.778355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 419/862] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:09.778355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.798499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394b969-2d06-40d6-a2b0-8383123020d0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.835072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.835766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.836059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.836324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.837034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:09.837339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.838715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.843718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 444/863] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:09.844399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.890448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7456a7-d01d-4f5a-8f9c-b4d8532bac87 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.926279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.926971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.927204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.927450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:09.928201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:09.928507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:09.929902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:09.934739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 420/864] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:09.935594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:09.953434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702caae7-b59c-41ef-a57e-b5c79a401d3e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:09.993530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:09.994826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:09.995761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:09.996236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.012096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.014404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:10.039871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:10.041134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:10.042279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:10.042279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:10.042279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:10.042279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:10.044749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 445/865] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:10.050105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:10.066513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d7b7-64aa-49c2-a2f7-e86c5cb3e9b6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:10.115699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:10.115699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:10.115699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:10.115699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.116169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:10.116169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.116169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.116374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 421/866] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:10.178413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838282-640b-466a-89a6-1ab3c564992a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:10.217164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:10.217913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:10.218198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:10.218516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.219307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:10.219709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.221142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.235278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 446/867] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:10.240885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:10.357029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423ffe2-8eee-4b66-b4c7-8ebfe3772460 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:10.396463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:10.397763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:10.398264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:10.398758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.408038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.409963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:10.426867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:10.427911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:10.428874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:10.431838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 422/868] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:10.437628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:10.616597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb3a-d635-43b8-9897-7392c0348c58 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:10.655475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:10.656182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:10.656465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:10.656743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.657600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:10.657911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.659363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4694-0266-48e0-9498-b62d193e0d9c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.672605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 447/869] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:10.678296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:10.785468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a663e1-5008-4489-9919-0b0ad85b6eb0 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:10.819805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:10.820842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:10.821351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:10.821821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:10.822862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=9a66dd362d8f445f9c8f4027c4bd4f6c) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:10.823363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:10.825100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a42433-c572-4836-9244-1ea18397e349 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:10.832280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 423/870] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:10 2022] GET /identity/v3/role_assignments?user.id=9a66dd362d8f445f9c8f4027c4bd4f6c&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:11.639885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c59-fea0-4128-a731-9a6399cf40c6 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:11.640913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c59-fea0-4128-a731-9a6399cf40c6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:11.641424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c59-fea0-4128-a731-9a6399cf40c6 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:11.643418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 448/871] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:11.649604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:11.650593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:11.651110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:11.671643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:11.673537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:11.750568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 424/872] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:11.775417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325c59-fea0-4128-a731-9a6399cf40c6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:11.887173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325c59-fea0-4128-a731-9a6399cf40c6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:11.923960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:11.924835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:11.925118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:11.925422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:11.926090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:11.927579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:11.940715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:11.941800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:11.942651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 449/873] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:11.950253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:12.052933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63493f9-89eb-4f73-9b75-c7009eff84d3 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:12.092605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:12.093692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.094190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.094725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.095759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:12.096296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:12.097999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656558b1-b7ea-4997-ba03-925641b0c37d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:12.104161 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 425/874] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:12.110512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:12.220441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319697f-56c1-4dea-83fe-a1618851b232 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:12.275193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:12.275931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.276221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.276492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.277241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:12.277542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:12.279502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71a79-b7bb-4fd4-8514-f4c67ece9768 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:12.285728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 450/875] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:12.288980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560abd-7932-461c-9ee9-f6bc69996d81 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.289277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560abd-7932-461c-9ee9-f6bc69996d81 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.289539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560abd-7932-461c-9ee9-f6bc69996d81 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.291335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 426/876] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:12.297288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c95d-b6f9-4557-ac54-d2d9e7a7257b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.297737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c95d-b6f9-4557-ac54-d2d9e7a7257b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.298017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c95d-b6f9-4557-ac54-d2d9e7a7257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.317308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d976c95d-b6f9-4557-ac54-d2d9e7a7257b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:12.318655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d976c95d-b6f9-4557-ac54-d2d9e7a7257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:12.401994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 451/877] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:12.425739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560abd-7932-461c-9ee9-f6bc69996d81 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:12.545257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560abd-7932-461c-9ee9-f6bc69996d81 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:12.580599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:12.581329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.581601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.581868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.582606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:12.584113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecbbc-16be-44c7-95bd-da178345e1aa None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:12.599449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 427/878] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:12 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:12.609479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120862-def6-4595-be03-e95a346c003f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.609838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120862-def6-4595-be03-e95a346c003f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.610128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120862-def6-4595-be03-e95a346c003f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.612001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 452/879] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:12.618267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee3d6-090b-4eae-92ce-25c4c4021e56 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.618594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee3d6-090b-4eae-92ce-25c4c4021e56 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.618821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee3d6-090b-4eae-92ce-25c4c4021e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.638191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-372ee3d6-090b-4eae-92ce-25c4c4021e56 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:12.639545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-372ee3d6-090b-4eae-92ce-25c4c4021e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:12.728408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 428/880] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:12 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:12.752826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120862-def6-4595-be03-e95a346c003f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:12.874757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120862-def6-4595-be03-e95a346c003f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:12.912035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:12.912708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:12.912984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:12.913259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:12.913992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:12.915372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d682b0c-7009-4fb8-b488-887d8b795765 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:12.933755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 453/881] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:12 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:13.277390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227407-da2f-4e9d-83c6-98b6d38c5981 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:13.278139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227407-da2f-4e9d-83c6-98b6d38c5981 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:13.278307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227407-da2f-4e9d-83c6-98b6d38c5981 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:13.280079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 429/882] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:13.286028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:13.286322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:13.286578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:13.303702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:13.305010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:13.388764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 454/883] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:13.412262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227407-da2f-4e9d-83c6-98b6d38c5981 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:13.530019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227407-da2f-4e9d-83c6-98b6d38c5981 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:13.569597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:13.570427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:13.570724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:13.570992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:13.581822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:13.589898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:13.592086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:13.594099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 430/884] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:13.599700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:13.694862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f249c4-54da-41be-9aad-36c7b0613f96 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:13.729627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:13.730315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:13.730599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:13.730904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:13.731677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:13.732030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:13.733448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:13.742183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 455/885] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:13.748110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:13.859091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af880-6306-448a-ab8d-efa425dd3f9f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:13.897283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:13.898108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:13.898387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:13.898664 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:13.916651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:13.918157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:13.937567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:13.939651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:13.941006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:13.941006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:13.941006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:13.941006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:13.941006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 431/886] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:13.945057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.046967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b38c-5599-454e-b76e-3b6787e9ffd1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.080525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:14.081200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.081482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.081748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.082478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:14.082798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:14.084298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:14.097069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 456/887] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:14.102347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.215252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391fdd3-4012-482b-b63c-9d3499322f3b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.253462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:14.254328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.254604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.254942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.264389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:14.265945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:14.282144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:14.284546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:14.286701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 432/888] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:37:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:14.291967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.399293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81ba35-f123-4b28-91eb-d0d08638ceab None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.433843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:14.434527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.434802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.435068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.435951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:14.436257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:14.437690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295115-19db-464c-a7fb-9bc4fcdecbed None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:14.455492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 457/889] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:14.460945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.569494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a494c8-c03f-4a94-88f7-2e05c4092098 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.613217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:14.614615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.615352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.616189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.687162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:14.689093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:14.720207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edede8-b309-4d9a-acdb-403826e9769a None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.720675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edede8-b309-4d9a-acdb-403826e9769a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.720906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edede8-b309-4d9a-acdb-403826e9769a None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.726427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 458/890] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:14.728170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.728460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.728738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.745356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:14.746552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:14.796762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 433/891] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:14.802282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.831869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 459/892] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:14.849582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:14.923642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6907-2d4e-4494-b732-c74932c6deb6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.961956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:14.962891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:14.963188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:14.963488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:14.976039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:14.977769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:14.980661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdee01-56d6-4269-8b6c-fe50c7099314 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:14.998744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:14.999835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:15.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:15.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:15.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:15.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:15.001465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 434/893] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:15.006199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.033068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.034116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.034403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.034673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.035415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.036857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d282f5-19c9-40b2-a344-34f3ff2d1b7d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.063707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 460/894] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:14 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:15.086236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b21-84c5-4f31-aa15-1b691032c5b0 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.086423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b21-84c5-4f31-aa15-1b691032c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.086669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b21-84c5-4f31-aa15-1b691032c5b0 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.088732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 461/895] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:15.096577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.097253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.097742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.132229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:15.133875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:15.136933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964c23-6570-40a1-83d7-124cee822f6f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.178884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.179631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.179939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.180207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.180984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:15.181322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.182787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.200244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 435/896] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:15.201475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.219999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 462/897] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:15.239776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.337208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490b3f6-9478-485a-9cff-e8363b2d7834 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.376091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14010-fd65-411a-9a95-cd8e27fe502c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.378512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.379354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.379629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.380005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.387725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.389292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.414139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.414951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.415426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-7d30e68a-9df8-4a42-88d3-179c59192479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:15.415540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:15.416585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:15.417823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 436/898] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:15.418783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.419494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.422254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b683b-5c16-4a61-a169-a024d15bf35a None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.422836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b683b-5c16-4a61-a169-a024d15bf35a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.423331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b683b-5c16-4a61-a169-a024d15bf35a None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.425261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.427057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 437/899] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:15.428120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b683b-5c16-4a61-a169-a024d15bf35a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f6106367-b9c6-4627-b8b0-cc866b6dfa41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:15.438521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:15.439545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:15.440808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 463/900] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:15.441675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.441675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.442231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.460796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:15.462068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:15.538761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 464/901] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:15.539641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.563464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b683b-5c16-4a61-a169-a024d15bf35a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.602214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.602815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.603095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.603371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.604221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:15.604529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.606028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.623478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 438/902] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:15.624795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.659096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e73d32-59a9-4233-813e-05d00e865fa0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.697575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.698706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.699229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.699562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.700362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:15.700665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.702081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.707547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 465/903] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:15.708468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.746268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567622e4-b461-41dd-9bdc-043da40f4d76 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.792292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.793243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.793526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.793785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.794446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.795906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:15.811765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:15.819340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:15.820403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 439/904] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:15.821376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.851931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d78d0-c911-4186-a193-370e83610b2f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.903065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.904018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.904445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:15.904913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:15.906070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] RBAC: Adding query filter params (role.id=5940594e389c4022addcf8929b4eae81, scope.project.id=b3accb6964814c09a848544b57230884, user.id=9a66dd362d8f445f9c8f4027c4bd4f6c) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:15.906576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:15.908352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:15.924114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 466/905] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/role_assignments?user.id=9a66dd362d8f445f9c8f4027c4bd4f6c&scope.project.id=b3accb6964814c09a848544b57230884&role.id=5940594e389c4022addcf8929b4eae81 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:15.925559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:15.956242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff841f1-9101-411a-a033-2a73517a008c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:15.998202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:15.999392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:15.999939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.000424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.001440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:16.002058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.003949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.010594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 440/906] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:16.019496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:16.067207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84968e9-85a2-4f37-a670-bec2a97e189c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.110688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.111560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.111983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.112355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.113185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:16.113616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.115134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.126752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 467/907] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:16.127015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:16.134092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7a80-8fbe-4d09-ba8f-a3c7aecaf756 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.176743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.177350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.177633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.177943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.178778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] RBAC: Adding query filter params (interface=public, service_id=dc30de5221d34f15a6b2b31ad5bae6fd, region_id=RegionOne) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:16.179155 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.180615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.191848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 441/908] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:16 2022] GET /identity/v3/endpoints?service_id=dc30de5221d34f15a6b2b31ad5bae6fd&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:16.193628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:16.247808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506b5a-eafe-4358-bee6-9e4e9ca6e1a7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.282086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.282790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.283068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.283339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.284292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:16.284627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.286564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.295891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 468/909] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:16.297075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:16.331220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482bad-1e5a-412c-a899-0fa5da81053a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.372243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.372923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.373204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.373474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.374158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.375615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.387727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 442/910] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:16 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:37:16.442054 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd2cc-85f7-44ce-a93b-b9e222aed21f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.479703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.480399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.480677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.480948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.481784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] RBAC: Adding query filter params (interface=public, service_id=c9c210e962d64f07a4b74abb6d0227fa, region_id=RegionOne) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:16.482085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.483558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a78f3-f934-4e45-941b-cf91f4977e54 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.490268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 469/911] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:16 2022] GET /identity/v3/endpoints?service_id=c9c210e962d64f07a4b74abb6d0227fa&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:16.496807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:16.612319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cba2dc-2c49-40a1-ae5f-b87fe30af2bb None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:16.653569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:16.654605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:16.655087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:16.655559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:16.656554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:16.658451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a530b-b195-45a7-907a-c80b9887a38d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:16.665506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 443/912] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:16 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:37:17.462323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bee5b-f5fe-4fd7-9ee4-b8908f95bf7f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:17.463046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bee5b-f5fe-4fd7-9ee4-b8908f95bf7f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:17.463046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bee5b-f5fe-4fd7-9ee4-b8908f95bf7f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:17.464587 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 470/913] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:17.470690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:17.471298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:17.471630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:17.491111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:17.492347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:17.567843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 444/914] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:17.586504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bee5b-f5fe-4fd7-9ee4-b8908f95bf7f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:17.698321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bee5b-f5fe-4fd7-9ee4-b8908f95bf7f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:17.736738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:17.737627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:17.737911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:17.738187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:17.738855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:17.740279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:17.752925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:17.755227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:17.757221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 471/915] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:17.763516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:17.875078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8abeda-0479-4d74-99bd-a67929ff75f4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:17.911513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:17.912256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:17.912537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:17.912807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:17.913521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:17.913823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:17.915259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:17.925405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 445/916] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:17.926894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.052847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dfb3f-ab24-4b5a-b42d-7eb875c81130 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:18.099262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:18.100311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.100793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.101259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.102212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:18.102724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:18.104371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002eb37-fc16-4f62-873c-5e1ff39f0686 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:18.115389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 472/917] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:18.117314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.227168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85fb62-6abf-4afa-89f1-dff39f1d42cd None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:18.250939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8110b62-727c-4acd-93f7-6bda24350d7d None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.251147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8110b62-727c-4acd-93f7-6bda24350d7d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.251366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8110b62-727c-4acd-93f7-6bda24350d7d None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.253656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 473/918] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:18.261948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.262404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.262776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.280274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:18.281780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.282544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.283253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.283767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:18.285074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:18.285673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] RBAC: Adding query filter params (interface=public, service_id=0571de80b2ad4ea9862857aaf38e4eb9, region_id=RegionOne) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:18.286438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:18.289376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:18.300496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 446/919] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/endpoints?service_id=0571de80b2ad4ea9862857aaf38e4eb9&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:18.307600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.396311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 474/920] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:18.415447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.512927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19239857-11a2-46f2-b265-a3ed05f40d74 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:18.575872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:18.577532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.578312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.579076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.580637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:18.582002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9a346-2d7d-4890-a6fd-bb47be75d1eb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:18.584394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:18.603883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 447/921] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/services => generated 1497 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:37:18.643421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:18.644754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.645240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.645696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.664938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f14e30a0-31a0-4e39-ad73-cb5627387c7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:18.679645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:18.681528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:18.682997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 475/922] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:18.693989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.775713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811f7-35c3-46be-8664-e43cca14c5da None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.776066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811f7-35c3-46be-8664-e43cca14c5da None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.776314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811f7-35c3-46be-8664-e43cca14c5da None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.778719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 476/923] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:18.785466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.785912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.786427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.812632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:18.814248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:18.857151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6946-27e0-418a-b9eb-6c3bfb5107fa None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:18.909719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 477/924] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:18.923591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:18.924561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:18.924843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:18.925194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:18.926107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:18.926428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:18.928421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:18.935491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:18.943560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 448/925] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:18.950479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.076690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a5e24-5e9f-4c65-abc8-b6616d01d197 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.086194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa506f-1f9e-482a-82da-dd2035ede2cd None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.122045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.122800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.123070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.123341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.124052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.125490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-937a0036-68a6-47d1-bc9e-f78a48d47e23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:19.138279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:19.139803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:19.141987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 478/926] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:19.143189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6f2b-79b3-4a1f-a0be-ba4e75536d5e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.143189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6f2b-79b3-4a1f-a0be-ba4e75536d5e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.143189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6f2b-79b3-4a1f-a0be-ba4e75536d5e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.143840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 479/927] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:19.145895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6f2b-79b3-4a1f-a0be-ba4e75536d5e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.148762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.149618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.149906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.150166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.164316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.165828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-5a200534-8654-4d7b-bea0-d09be894d67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:19.184268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:19.185336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:19.186596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:19.186596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:19.186596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:19.186596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:19.190441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 449/928] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:19.192034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.192316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.192589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.212497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:19.213765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:19.273565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6f2b-79b3-4a1f-a0be-ba4e75536d5e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.311834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.312538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.312815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.313212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.313944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:19.314253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.316855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.324043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 480/929] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:19.324043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.327871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 450/930] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:19.331773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.437730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e958a85-19da-4ca6-b70c-fcf0def8cc49 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.478447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979571-8588-4536-9775-0be693d53142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.479149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979571-8588-4536-9775-0be693d53142 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.479422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979571-8588-4536-9775-0be693d53142 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.479721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979571-8588-4536-9775-0be693d53142 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.479865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdecf8-f604-47e6-992b-9d6205d5d587 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.480439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979571-8588-4536-9775-0be693d53142 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:19.480734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979571-8588-4536-9775-0be693d53142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.482163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979571-8588-4536-9775-0be693d53142 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.496346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 451/931] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:19.496346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979571-8588-4536-9775-0be693d53142 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.526841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.528310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.528776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.529230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.530489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:19.531027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.532946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.547724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 481/932] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:19.547724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.625645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979571-8588-4536-9775-0be693d53142 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.661496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882817e6-a4a2-465c-aad4-e152d8c62afd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.668438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.669747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.670204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.670677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.671876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.674456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:19.688794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:19.689983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 14:37:19.690995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:19.695084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 452/933] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:19.696069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.701833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.702762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.703179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.703584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.704618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.706183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.730426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 482/934] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:19.732021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:19.866399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb644-d82a-4c01-9fa1-9595a0f1bed4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.939136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:19.940786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:19.941350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:19.941901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:19.947176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d510a-4eac-47a0-94ac-3bcfb6691ebd None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:19.958179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:19.958742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:19.983080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:19.985264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:19.987096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 453/935] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:19.993286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.003777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.004935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.005433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.005934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.007219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:20.007824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.010357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.021696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 483/936] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:20.028883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.120550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d9c5-626a-4e84-9666-4b6cd1fa54e7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.158337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.159426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.159954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.160446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.161497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:20.162025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.163923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.183468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 454/937] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:37:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:20.191833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.217246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca57-093e-40b5-be0a-e9afdaa7c536 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.280786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.281953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.282492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.283009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.284342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:20.284854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.287856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.301191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 484/938] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 14:37:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:20.302951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.309867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2b1b-231c-43c0-830d-415df16b4b56 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.366992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.367900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.368179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.368577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.379995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.381506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:20.416090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:20.418015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:20.420253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:20.420253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:20.420253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:20.420253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:20.431438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 455/939] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:20.433494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.488000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ec23-a2e1-4cd1-afc8-cc198a5ce48f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.543484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767f62-765f-46ac-bc7f-abeeb0a5d6b8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.549396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.550953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.551770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.552528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.554171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.557076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.583190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.584002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.584324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.584596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.585380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:20.585687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.587452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.599690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 485/940] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:20.608822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 456/941] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:20.618872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:20.789575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587479ff-f2b1-49fb-b3a5-342fcf456107 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:20.829265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:20.830087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:20.830361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:20.830634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:20.838560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:20.840079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:20.855558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:20.857277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:20.859024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 486/942] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:20.865977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:21.035507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a742-a923-46c8-b5ed-d71ac773851c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:21.089556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:21.090129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:21.090409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:21.090686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:21.091495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:21.091837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:21.093321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc297d-dc8e-4386-9861-d0c9b91ae13f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:21.107703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 457/943] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:21.117658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:21.227632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceda09-da2c-469c-b960-ec13b2f015a0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:21.264041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:21.264997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:21.265286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:21.265536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/9a66dd362d8f445f9c8f4027c4bd4f6c/roles/5940594e389c4022addcf8929b4eae81` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:21.268147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=9a66dd362d8f445f9c8f4027c4bd4f6c, role_id=5940594e389c4022addcf8929b4eae81)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:21.269724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1c93d-c95e-4d2c-ac9b-5e803dbd7338 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:21.288723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 487/944] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:21 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/9a66dd362d8f445f9c8f4027c4bd4f6c/roles/5940594e389c4022addcf8929b4eae81 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:22.166928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230110-8489-4562-b9da-ffbe1d4aaf95 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:22.167749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230110-8489-4562-b9da-ffbe1d4aaf95 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:22.167882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230110-8489-4562-b9da-ffbe1d4aaf95 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:22.170756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 458/945] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:22.180418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:22.181196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:22.181330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:22.203214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:22.204502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:22.277501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 488/946] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:22.318882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0230110-8489-4562-b9da-ffbe1d4aaf95 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:22.456763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0230110-8489-4562-b9da-ffbe1d4aaf95 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:22.492761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:22.493601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:22.493846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:22.494126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:22.494799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:22.496292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:22.508930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:22.512542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:22.519716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 459/947] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:22.522863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:22.670671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059df7f1-4474-4df1-be7d-7a612f4b7dc8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:22.710378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:22.710966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:22.711239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:22.711514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:22.712283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:22.712585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:22.714004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:22.719979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 489/948] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:22.728946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:22.914269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefecd1d-4710-4157-a697-e3ce6f67d5e8 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:22.955562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:22.956291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:22.956596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:22.956834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:22.957575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:22.957879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:22.959312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc4cb-53d8-45e9-8860-320fd5521413 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:22.965726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 460/949] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:22.975902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:23.138232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe018c-bc65-4b56-a6ba-cf03779b61bc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:23.179331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:23.180065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:23.180354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:23.180602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:23.181467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:23.182855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acad5-7327-418f-b93d-1c1d8faea2f3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:23.209915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 490/950] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:37:23.440342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc14d7-2245-4c3e-8508-c77d3b3afc45 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:23.441142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc14d7-2245-4c3e-8508-c77d3b3afc45 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:23.441142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc14d7-2245-4c3e-8508-c77d3b3afc45 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:23.442642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 461/951] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:23.448593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:23.448903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:23.449136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:23.468151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:23.469437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:23.557712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 491/952] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:23.579794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc14d7-2245-4c3e-8508-c77d3b3afc45 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:23.735085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc14d7-2245-4c3e-8508-c77d3b3afc45 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:23.800771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:23.802626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:23.803147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:23.803624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:23.805014 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:23.808278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:23.831400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:23.832590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:23.833496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:23.834267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 462/953] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:23.844441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.008764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ddc64-bbae-4091-9294-73747fcfb8e1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:24.050703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:24.051818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.052301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.052792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.053714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:24.054244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:24.055891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab2c18-b6a9-4809-9e63-4175c7c512e7 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:24.062107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 492/954] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:24.072041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.274905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118f0b3-479f-4b3f-b2e3-a5a7e732f2d5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:24.306814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a6204-0b6e-40d1-acee-f95b011cc43e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.307358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a6204-0b6e-40d1-acee-f95b011cc43e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.307828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a6204-0b6e-40d1-acee-f95b011cc43e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.316649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 493/955] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:24.319568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.320127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.320602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.338986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:24.340153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.340629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.341099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.342394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:24.343383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:24.345735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3ed0e-dcf0-424a-a473-6022e0e340fd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:24.355756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 463/956] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:24.371967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:24.374428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:24.401309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d654-8bbe-44b6-9e26-48a01c7b4f82 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.401774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d654-8bbe-44b6-9e26-48a01c7b4f82 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.402156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d654-8bbe-44b6-9e26-48a01c7b4f82 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.405097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 464/957] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:24.411126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.411385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.411628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.432213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:24.433902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:24.510126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 494/958] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:24.552232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.560840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 465/959] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:24.584717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.731947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dde0d-320b-4e3b-8e9f-aa491aec1b26 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:24.768649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8187c-82cd-426d-9056-10c8aeb544e4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:24.773428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:24.774126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.774398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.774675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.775411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:24.776980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:24.778806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING keystone.server.flask.common [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 14:37:24.799604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.sql.core [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 14:37:24.799604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 14:37:24.799604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [parameters: {'id': '8aec11e1154a49148d7cf347b422c59a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 14:37:24.799604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86303) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8aec11e1154a49148d7cf347b422c59a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8aec11e1154a49148d7cf347b422c59a. May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application conn.query(q) May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:37:24.821446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result.read() May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 14:37:24.823245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application next(self.gen) May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application yield resource May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application next(self.gen) May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.session.rollback() May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.force_reraise() May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise self.value May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application session.commit() May 04 14:37:24.825263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._prepare_impl() May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.session.flush() May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._flush(objects) May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application compat.raise_( May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application flush_context.execute() May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 14:37:24.827012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rec.execute(self) May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 14:37:24.828874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application conn.query(q) May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result.read() May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:37:24.830863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [parameters: {'id': '8aec11e1154a49148d7cf347b422c59a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:24.833667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:24.836466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8aec11e1154a49148d7cf347b422c59a. May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 495/960] 10.222.0.21 () {60 vars in 1140 bytes} [Wed May 4 14:37:24 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:24.838431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.853409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:24.855329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:24.856247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:24.857008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:24.877719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:24.893779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:24.895480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:24.897081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:24.900994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 466/961] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:24.909832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:24.962500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95fd-c498-4645-9364-19911074cea3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.000134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.001494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.001879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.002155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.010040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.011767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:25.028939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:25.030633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:25.032419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 496/962] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:25.037984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.042836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3f3c-f2f1-40b4-a2d4-d7e017604031 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.081078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.081671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.081948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.082211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.082978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:25.083291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.084760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.098502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 467/963] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:25.099484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.149145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af065-efdf-43d0-b654-c8b5a05b30ca None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.185821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.186782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.187161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.187540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.188508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:25.188917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.190517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.199384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d8da-51c2-4994-941a-a794adf4dcbd None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.213169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 497/964] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:25.249885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.250801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.251080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.251343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.264291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.265784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:25.285214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:25.287222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:25.290153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:25.290153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:25.290153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:25.290153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:25.290153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 468/965] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:25.296923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.433435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c29b-da99-4023-a920-4f98d3807c99 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.473473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.474526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.475028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.475511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.476490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:25.477006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.478728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.492211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 498/966] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:25.498237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.603280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695467-8709-4335-8f1d-0f8f0a52ae13 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.642490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.643328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.643601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.643900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.653620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.655321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:25.670829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:25.671907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:25.673421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 469/967] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:25.679147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.809020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7c0d5-e80c-4eb5-a230-2b72d1550fd5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:25.844473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:25.845160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:25.845447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:25.845718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:25.846568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:25.846879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:25.848353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:25.867416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 499/968] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:25.876524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:25.981659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29a17-b47e-4ac2-92e2-0eb6e16a5567 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:26.017398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:26.018086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.018372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.018648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.091158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:26.092702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:26.197497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 470/969] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:25 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:26.203277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:26.310388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca40ff-6c65-4531-b0fa-aeea21a85cc8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:26.362460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:26.363281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.363556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.363857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.374695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:26.376369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:26.395238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:26.396256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:26.397614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:26.397614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:26.397614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:26.397614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:26.397614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 500/970] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:26.404826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:26.543502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec38b3-262c-4954-ae2e-715e8ed2ba7d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:26.583990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:26.585059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.585539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.585983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.587092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:26.587593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:26.589314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf06329-78b3-4b7d-a598-08bbf01a420e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:26.602450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 471/971] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:26.609021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:26.742114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf061e-c7f9-44d2-b0e0-dbc012eaac7a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:26.753049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3715b4-8c6e-4a9f-bf98-23c774b2c7d4 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.753586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3715b4-8c6e-4a9f-bf98-23c774b2c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.753586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3715b4-8c6e-4a9f-bf98-23c774b2c7d4 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.755105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 472/972] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:26.760943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.761570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.762048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.781871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:26.783725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:26.784193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:26.785016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:26.785295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:26.785570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:26.794603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:26.796776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:26.816965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:26.818160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:26.819396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 501/973] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:26.825026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:26.887698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 473/974] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:26.925919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:26.961363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaead4-4975-46ee-a47a-1d5aed47573c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.004678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.005386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.005746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.005971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.006757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:27.007064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.008681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.031716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 502/975] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:27.036447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.086018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6041e-a933-48c3-b3e7-27a0a9c7f95a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.122490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.123259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.123533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.123835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.124519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.126042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:27.138800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:27.140762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:27.142359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:27.145631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 474/976] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:27.146614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.199147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66177871-7f82-4211-89d7-be1f9d1f7fcc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.244129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.244829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.245104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.245373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.246208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] RBAC: Adding query filter params (role.id=5940594e389c4022addcf8929b4eae81, scope.project.id=b3accb6964814c09a848544b57230884, user.id=9a66dd362d8f445f9c8f4027c4bd4f6c) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:27.246550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.248040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.254762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 503/977] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:27 2022] GET /identity/v3/role_assignments?user.id=9a66dd362d8f445f9c8f4027c4bd4f6c&scope.project.id=b3accb6964814c09a848544b57230884&role.id=5940594e389c4022addcf8929b4eae81 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:27.278863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2bc6-b59b-44aa-b5ce-e64aa0e758a7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.316644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.317340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.317625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.317958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.318697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:27.319046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.320556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8b07-766d-43dc-ab5a-e8b2e0a9ada7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.326856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 475/978] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:27.333008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.363547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9613f-e8ac-47be-baba-56aeebf7cbcf None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.363915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9613f-e8ac-47be-baba-56aeebf7cbcf None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.364151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9613f-e8ac-47be-baba-56aeebf7cbcf None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.365986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 476/979] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:27.371770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.372088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.372320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.390624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:27.391985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:27.456026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb057-b954-4fd9-9db1-64b0b911ec23 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.482298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 477/980] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:27.497261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.497931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.498208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.498479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.499192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:27.499494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.501190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.505575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.510527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 504/981] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:27.518081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.627978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752f7b-e908-4272-9118-e67f23fccf62 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.638753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32376f21-21a2-411f-9362-e349579c9f4d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.669593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.670454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.670820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.671190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.672169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.673644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.689125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.690191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.690759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.691286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.691497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 478/982] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:27 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:37:27.701065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] RBAC: Adding query filter params (interface=admin, service_id=0571de80b2ad4ea9862857aaf38e4eb9, region_id=RegionOne) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:27.701448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.703389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a488d-cc01-4a4d-b0fc-a4cb2f035eff None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.713427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 505/983] 10.222.0.21 () {56 vars in 1249 bytes} [Wed May 4 14:37:27 2022] GET /identity/v3/endpoints?service_id=0571de80b2ad4ea9862857aaf38e4eb9&interface=admin®ion_id=RegionOne => generated 193 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:27.719470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:27.846429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef410c-fc9e-44d0-b6a0-e00b539306f6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:27.900776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:27.903139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:27.903733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:27.904399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:27.905900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:27.908467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fed2d5-106c-475e-b761-dffa2ed53734 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:27.916240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 479/984] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:27 2022] GET /identity/v3/services => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:37:28.003956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73139f-a7c5-44f4-914e-4888a48670e6 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:28.004323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73139f-a7c5-44f4-914e-4888a48670e6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:28.004541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73139f-a7c5-44f4-914e-4888a48670e6 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:28.006346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 506/985] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:28.012214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:28.012515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:28.012778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:28.031248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:28.032526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:28.111889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 480/986] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:28.136146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73139f-a7c5-44f4-914e-4888a48670e6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:28.253105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73139f-a7c5-44f4-914e-4888a48670e6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:28.292317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:28.293028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:28.293304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:28.293575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:28.294367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:28.295963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:28.311304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.sql.core [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 14:37:28.311304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 14:37:28.311304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [parameters: {'user_id': '5985a3077b394712932fd160097a6e21', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 14:37:28.311304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86303) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application conn.query(q) May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result.read() May 04 14:37:28.319530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:37:28.320507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application next(self.gen) May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application yield resource May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application next(self.gen) May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.session.rollback() May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.force_reraise() May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise self.value May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application session.commit() May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 14:37:28.321469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._prepare_impl() May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.session.flush() May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._flush(objects) May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application compat.raise_( May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application flush_context.execute() May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rec.execute(self) May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 14:37:28.322398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 14:37:28.323308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result = self._query(query) May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application conn.query(q) May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application result.read() May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 14:37:28.324241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [parameters: {'user_id': '5985a3077b394712932fd160097a6e21', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:28.325094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 14:37:28.325900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:28.326934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 507/987] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 14:37:28 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:28.335694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:28.435948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6d909-1be0-4cf0-ba15-b2bbaf94b96c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:28.471962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:28.473215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:28.473721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:28.474186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:28.482333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:28.484156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-5437c662-bf7c-4705-b30f-5c5e3403ecba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:28.499443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:28.500696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 14:37:28.501706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:28.504555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 481/988] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:28.515689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:28.613185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99521de2-59c9-4225-a167-3b23cc750cb1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:28.648471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:28.649137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:28.649414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:28.649681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:28.650516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:28.650912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:28.653050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8800b5c-d908-4445-b7a1-9172e0c1d88a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:28.699835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 508/989] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 14:37:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:29.664770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a07cc-ca4d-404b-bcd4-2e52105a7c1d None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:29.665335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a07cc-ca4d-404b-bcd4-2e52105a7c1d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:29.665335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a07cc-ca4d-404b-bcd4-2e52105a7c1d None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:29.666856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 482/990] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:29.672331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:29.672884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:29.672884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:29.690255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:29.691838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:29.761193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 509/991] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:29.783710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a07cc-ca4d-404b-bcd4-2e52105a7c1d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:29.883861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a07cc-ca4d-404b-bcd4-2e52105a7c1d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:29.922169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:29.922910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:29.923198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:29.923470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] PATH_INFO: `/v3/services/image` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:29.924189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:29.925640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-80b4f209-4821-468a-9d8f-2bfcafaa8743 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:29.938721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:29.940241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:29.941129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:29.944090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 483/992] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 14:37:29 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:29.946426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.047782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8720091-ba33-4ce4-b044-ddf4e1d06619 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.084366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.085050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.085326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.085591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.086322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.086621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.088098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.093951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 510/993] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:30.097964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e6ac-99c3-4c5d-9e88-452cc451a24c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.098279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e6ac-99c3-4c5d-9e88-452cc451a24c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.098552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e6ac-99c3-4c5d-9e88-452cc451a24c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.100177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 484/994] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:30.100320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.106702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.107019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.107277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.124816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:30.126478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:30.196661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 485/995] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:30.204433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e784a-ffcb-4466-aa7b-82b1473964f1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.219708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.238730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.239823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.240328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.240792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.241690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] RBAC: Adding query filter params (type=image) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.242071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.243582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6446aa-1d8c-4b38-8045-52429e99bf5f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.255280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 511/996] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:30.277844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92fc4-fc40-4bfa-bbb8-cf26b57c6ffe None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.278296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92fc4-fc40-4bfa-bbb8-cf26b57c6ffe None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.278402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92fc4-fc40-4bfa-bbb8-cf26b57c6ffe None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.280359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 512/997] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:30.286498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.286782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.287112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.305778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:30.307015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:30.335070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0224e-e621-4653-9e63-dbbef61b10ec None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.372017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.372922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.373206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.373477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.374141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.375684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:30.387906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:30.389143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:30.395383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 486/998] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:30.396729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 513/999] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:30.396820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.414199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.505875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b32c-6ec9-4b17-b32d-ae40c480a7e9 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.523137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c18865-7ca5-46ab-8614-ebd98f22841c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.539185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.539901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.540181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.540453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.541169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.541458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.542856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.548074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 487/1000] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:30.553715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.558944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.560023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.560455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.560869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.561698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.563917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:30.579181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:30.580324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:30.581181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 514/1001] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:30.586742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.659243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1c364-8211-47d8-b172-070fb867ac5f None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.697222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.698678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.699137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.699553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.700433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.700899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.701304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e68cc-adc6-4f22-8539-53d633d297e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.702889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.708477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 488/1002] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:30.713960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.743126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.743878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.744166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.744430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.745201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.745502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.746932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.757385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 515/1003] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:30.760712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.821411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcae3d4-a547-4127-9632-e26ce187a75b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.855342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.856036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.856323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.856601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.857394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] RBAC: Adding query filter params (interface=public, service_id=71cd593f302b4a8bab6c784c7b55143c, region_id=RegionOne) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.857708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.859125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.862598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c2a08-c043-4c54-ae56-80a0e550d7c2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:30.864439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 489/1004] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/endpoints?service_id=71cd593f302b4a8bab6c784c7b55143c&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:30.870074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.898292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:30.898960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:30.899246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:30.899524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:30.900336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:30.900658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:30.902048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:30.907738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 516/1005] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:30.913004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:30.981332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159393ef-ed72-473f-aba4-33feae457773 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:31.017159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:31.017714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:31.017980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:31.018277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:31.018967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:31.020624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362609-1f00-49f7-8970-e1f6e1627203 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:31.035696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 490/1006] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:30 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:37:31.035932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55b4b7-5247-44dd-ad76-342fccda9482 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:31.067175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:31.067909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:31.068195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:31.068612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:31.069387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:31.070863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e086c3-ee9d-4ae5-be50-fb272f2b7af9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:31.099741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 517/1007] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:37:32.545347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe4b-1b86-4b49-934c-cab7918e34a9 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:32.545929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe4b-1b86-4b49-934c-cab7918e34a9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:32.546353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe4b-1b86-4b49-934c-cab7918e34a9 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:32.549078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 491/1008] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:32.556119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329621-991b-48cd-bd02-82ff9df89a5d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:32.556639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329621-991b-48cd-bd02-82ff9df89a5d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:32.557099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329621-991b-48cd-bd02-82ff9df89a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:32.585574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-05329621-991b-48cd-bd02-82ff9df89a5d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:32.587760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-05329621-991b-48cd-bd02-82ff9df89a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:32.727724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 518/1009] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:32.768364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe4b-1b86-4b49-934c-cab7918e34a9 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:32.956544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe4b-1b86-4b49-934c-cab7918e34a9 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:33.014463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:33.015455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.015976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.016410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.017612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:33.020233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd2d0-4832-4bc3-8583-7ba22cb0be8b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:33.051704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 492/1010] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:32 2022] POST /identity/v3/services => generated 242 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:33.455271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296b0a-4f97-491a-8f00-d962ae96fe47 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.455821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296b0a-4f97-491a-8f00-d962ae96fe47 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.456289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296b0a-4f97-491a-8f00-d962ae96fe47 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.458869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 519/1011] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:33.464672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d601-4955-494f-9dc3-55209b7b88ea None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.465029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d601-4955-494f-9dc3-55209b7b88ea None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.465267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d601-4955-494f-9dc3-55209b7b88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.483638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-60a4d601-4955-494f-9dc3-55209b7b88ea None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:33.484977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-60a4d601-4955-494f-9dc3-55209b7b88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:33.567243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 493/1012] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:33 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:33.590260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296b0a-4f97-491a-8f00-d962ae96fe47 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:33.702223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624fa7-f694-4c4e-9805-c35a6161481a None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.702499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624fa7-f694-4c4e-9805-c35a6161481a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.702750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624fa7-f694-4c4e-9805-c35a6161481a None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.704342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 494/1013] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:33.709671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.709945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.710214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.713286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296b0a-4f97-491a-8f00-d962ae96fe47 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:33.728285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:33.729492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:33.772510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:33.773892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.774385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.774889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.776933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:33.779754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:33.786909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 520/1014] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:33.788849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:33.801690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 495/1015] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:33 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:33.843647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:33.891679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c014ab-2522-4783-914d-1af8e69bd9a6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:33.930119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:33.930778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:33.931111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:33.931363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:33.932085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:33.933553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:33.963758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 521/1016] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:37:33 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:33.984379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd050-f953-4ad2-8e78-6898910f79ea None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:34.035615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:34.036481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:34.036760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:34.037070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:34.037728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:34.039219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:34.052200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:34.056257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:34.057126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 496/1017] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:34.065351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:34.220245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04da9c-2a2b-40bc-953b-d730754de697 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:34.277081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:34.278574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:34.279065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:34.279552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:34.280942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:34.281562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:34.284141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:34.293372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 522/1018] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:34.302907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:34.452769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44502d-3325-45d4-83df-0b738c45ba42 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:34.489140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:34.489707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:34.489982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:34.490273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:34.490958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:34.491278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:34.494237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30a3c-0479-46e6-8612-77ddae335fb4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:34.504046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 497/1019] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 14:37:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:34.514622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:34.713135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063bf78-aecd-4927-92f7-59320f8e121a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:34.771851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:34.772526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:34.772884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:34.773216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:34.774048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:34.775531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d116c-d4d8-4829-9485-8fbbaf81b69d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:34.807725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 523/1020] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:36.322581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b0c4-ff70-4cbe-83b5-9b11adddd1a8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.323143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b0c4-ff70-4cbe-83b5-9b11adddd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.323143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b0c4-ff70-4cbe-83b5-9b11adddd1a8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.325182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 498/1021] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:36.330667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17038-46a8-45f3-a997-b52478b9d7bb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.331444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17038-46a8-45f3-a997-b52478b9d7bb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.331444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17038-46a8-45f3-a997-b52478b9d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.351822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-75f17038-46a8-45f3-a997-b52478b9d7bb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:36.353030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-75f17038-46a8-45f3-a997-b52478b9d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:36.456800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 524/1022] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:36.493189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6b0c4-ff70-4cbe-83b5-9b11adddd1a8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:36.578298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea21-5de5-4e2b-99da-3fe4edf9bccd None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.578509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea21-5de5-4e2b-99da-3fe4edf9bccd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.578877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ea21-5de5-4e2b-99da-3fe4edf9bccd None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.580371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 525/1023] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:36.585827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.586136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.586371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.603711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:36.604643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:36.606961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6b0c4-ff70-4cbe-83b5-9b11adddd1a8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:36.642766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:36.643600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.643910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.644181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.645485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:36.647000 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:36.649016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 499/1024] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:36.657548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:36.687734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 526/1025] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:36.707453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:36.805912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6b12-47b0-4b67-97e7-7ce010b456a5 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:36.826772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643e18-2d82-4190-9778-2217356b21d7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:36.852497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:36.854083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.854864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.855339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.856504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:36.858935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:36.867283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:36.868123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:36.868400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:36.868670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] PATH_INFO: `/v3/services/image` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:36.869332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:36.870852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:36.884267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:36.885414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:36.889177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 527/1026] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 14:37:36 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:36.892307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:36.892867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 500/1027] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:37:36 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:37:37.022987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780e3e-2952-4bc8-a08f-fd63ce1c9b8e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:37.066726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:37.067765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.068196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.068618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.069524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] RBAC: Adding query filter params (name=image) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:37.070024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:37.071620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:37.078730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 528/1028] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:37.086872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:37.263714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644152a-5aa2-4315-a2c1-f871b724926a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:37.308781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:37.309573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.309881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.310295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.311163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] RBAC: Adding query filter params (type=image) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:37.311776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:37.314104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb840e-487a-43dc-be91-49059e8fa2eb None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:37.323152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 501/1029] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:37.329072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:37.413697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62e55-bbd6-419f-aa70-d5ef84e198ce None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.414090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62e55-bbd6-419f-aa70-d5ef84e198ce None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.414552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62e55-bbd6-419f-aa70-d5ef84e198ce None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.417175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 502/1030] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:37.422958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.423433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.423652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.441767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:37.443032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:37.508980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedac7-f2d7-423f-9978-eaadf72419db None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:37.545180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 503/1031] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:37.571641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:37.571978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:37.572878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.573353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.573823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.575345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] RBAC: Adding query filter params (interface=public, service_id=2a3a49d26f5848b4b6ca149481c94dd8, region_id=RegionOne) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:37.575948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:37.578675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:37.590257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 529/1032] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:37:37 2022] GET /identity/v3/endpoints?service_id=2a3a49d26f5848b4b6ca149481c94dd8&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:37.598258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:37.747147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9881b89-51fe-43d9-b486-3c840b25b112 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:37.780928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1032f3-ef23-43fb-b4f1-06d2d1d0cfb5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:37.790587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:37.791625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.792092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.792496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.813510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:37.828707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:37.830676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:37.832336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 504/1033] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:37.839133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:37.849952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:37.851095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:37.852073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:37.852073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:37.853491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:37.856593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:37.870089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 530/1034] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:37:37 2022] GET /identity/v3/services => generated 1957 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:37:38.027853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef44d6-eaa0-4b78-8282-59831d9b3c57 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:38.097027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:38.098115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:38.098602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:38.099091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:38.100476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:38.101040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:38.103786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:38.121093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 505/1035] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:38.130265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:38.322568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935feb-624f-4d46-9c73-416d789fa55d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:38.387544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:38.388806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:38.389276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:38.389704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:38.409156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:38.411822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:38.444798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:38.446592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:38.448369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:38.448369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:38.448369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:38.448369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:38.448369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 531/1036] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:38.459440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:38.642348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5cc6-f03e-47e7-ad1e-47049ac467fe None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:38.707015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:38.708192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:38.708684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:38.709175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:38.710594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:38.711139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:38.713947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:38.739220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 506/1037] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:38.747896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:38.936387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfbf52-4ef2-4476-939b-309a1a153ef0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:39.000473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:39.001829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.002317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.002746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.017731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:39.020879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-00f983f0-a7ac-4ab3-a9a3-75ee44c4ffbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:39.049571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:39.052256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:39.054142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:39.059807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 532/1038] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:37:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:39.061872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:39.241172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878533b9-61f1-45a4-a6a9-53ae90bc4279 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:39.302276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:39.303389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.303890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.304359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.305901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:39.306453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:39.309349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:39.344626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 507/1039] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:39.345340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41da19-f38d-45ad-8ab7-8a5b74ed03b2 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.345837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41da19-f38d-45ad-8ab7-8a5b74ed03b2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.346321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41da19-f38d-45ad-8ab7-8a5b74ed03b2 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.349076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 533/1040] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:39.354237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:39.354601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.354893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.355164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.372497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:39.373705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:39.469391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 534/1041] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:39.502804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9b22-b862-45ca-b679-c0a55ad2808c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:39.517415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:39.553515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:39.554572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.555178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.555652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.669051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:39.670888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:39.680850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e3f0-ff81-4c8e-b060-11c6177054c3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:39.727342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:39.728783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.729275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.729764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.745660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:39.754563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:39.757095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:39.758095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 535/1042] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:39.765228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:39.842914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 508/1043] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:39.851493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:39.924366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ed29-defc-4863-bfc3-16b441b4f5b0 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:39.970639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:39.971326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:39.971607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:39.971937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:39.972776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:39.973078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:39.974649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:39.985894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 536/1044] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:39.992565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.014580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087447-9c38-45a1-9448-4e2217c4c1cf None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.073254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.074510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.074928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.075388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.088250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.090484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:40.111405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:40.113570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:40.116493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:40.116493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:40.116493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:40.116493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:40.116493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 509/1045] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:40.121017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.141296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2109f9-c5e0-45f7-89a9-0fe9b3aafdfc None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.188596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.190363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.191066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.191813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] PATH_INFO: `/v3/users/dbc68d8a20344840b8a11f51ed5f3405` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.213348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc68d8a20344840b8a11f51ed5f3405)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.215654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.223500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 537/1046] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:39 2022] GET /identity/v3/users/dbc68d8a20344840b8a11f51ed5f3405 => generated 285 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:40.225068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.258690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f753171-555c-4598-ac27-ba04d7fff6d6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.316185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.317517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.318163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.318784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.320092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:40.320603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.322933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.343105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 510/1047] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:40.349305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.376040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084537-a621-4a12-b2de-07181609e0e9 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.417314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.418397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.418777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.419326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.478340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c7ec-f4fd-416c-8514-ee6702b82bb6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.512791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.515308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b64de-b967-45cd-bd0f-a4d833526457 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.528331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.530394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.531049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.531784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.542833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.545645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:40.570054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:40.571899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:40.573698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:40.575920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 511/1048] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:40.578492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.675292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 538/1049] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 14:37:40.677265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b391-8676-459d-9ad5-8bea2290c3d4 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.677640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b391-8676-459d-9ad5-8bea2290c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.678016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b391-8676-459d-9ad5-8bea2290c3d4 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.679439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 539/1050] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:40.681881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b391-8676-459d-9ad5-8bea2290c3d4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.720269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eeac1-037b-4016-9a1a-a3d10fa82c7c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.765839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.766672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.767117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.767549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.768959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:40.769452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.771926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ab946-0588-43b8-9305-a73a2ad907d4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.790587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 512/1051] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:40.792848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.793322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.793795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.813579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b391-8676-459d-9ad5-8bea2290c3d4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.814244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:40.815209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:40.850599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:40.851395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:40.851680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:40.851960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:40.853245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:40.854706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:40.856520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 540/1052] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:40.857322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.888687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 513/1053] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:40.889847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:40.967283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02812ce2-d7dd-47a4-95f6-72fff1463df3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:40.999804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2b90e-bc05-4f8a-8a38-e31272a21745 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:41.002702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.003374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.003656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.003960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.004801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] RBAC: Adding query filter params (role.id=5940594e389c4022addcf8929b4eae81, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:41.005115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.006593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.012554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 541/1054] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=5940594e389c4022addcf8929b4eae81 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:41.013405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:41.055598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.056639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.057061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.057476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.058879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=f227e25dfb0b4965acf7f8a9873158a2, user.id=dbc68d8a20344840b8a11f51ed5f3405) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:41.059347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.061782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.083566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 514/1055] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:40 2022] GET /identity/v3/role_assignments?user.id=dbc68d8a20344840b8a11f51ed5f3405&scope.project.id=f227e25dfb0b4965acf7f8a9873158a2&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:41.146028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fdee8-7010-4f53-bb84-afcfcd687bbb None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:41.191598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.192961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.193480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.193977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] PATH_INFO: `/v3/services/image` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.194932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.196769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:41.210790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:41.213013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:41.214841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 542/1056] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 14:37:41 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:41.222026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:41.367955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e92b-0b68-4c5f-b784-77487772fcd7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:41.407596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.408426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.408846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.409249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.410126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] RBAC: Adding query filter params (name=image) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:41.410572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.412220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.423081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 515/1057] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:41.424879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:41.541409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65224-3edb-421c-9700-74315f2d4c43 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:41.581042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.581915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.582348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.582760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.583655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] RBAC: Adding query filter params (type=image) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:41.584302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.585918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43738bda-ebd1-4119-9a14-ec12973b2712 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.597538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 543/1058] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:41.598971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:41.735214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9555-aaba-4c03-a70a-88776d339fe2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:41.802745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:41.804006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:41.804504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:41.804988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:41.806468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:41.809188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b542-7816-4a18-b940-67ea0ad1e889 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:41.848572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 516/1059] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:37:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:43.426240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6d9-eb6c-4c6f-bcfe-8cd3949c2be1 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.427019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6d9-eb6c-4c6f-bcfe-8cd3949c2be1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.427019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6d9-eb6c-4c6f-bcfe-8cd3949c2be1 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.428451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 544/1060] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:43.434121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab674-b335-4b8f-8aa9-46a79ae45a4d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.434904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab674-b335-4b8f-8aa9-46a79ae45a4d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.434904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab674-b335-4b8f-8aa9-46a79ae45a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.453271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6b1ab674-b335-4b8f-8aa9-46a79ae45a4d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:43.454470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6b1ab674-b335-4b8f-8aa9-46a79ae45a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:43.546435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 517/1061] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:43.550334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836bb0-c1dd-411b-8ba2-ac8aa98ada96 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.550833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836bb0-c1dd-411b-8ba2-ac8aa98ada96 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.551320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836bb0-c1dd-411b-8ba2-ac8aa98ada96 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.553995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 545/1062] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:43.563090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.563591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.564133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.569083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79836bb0-c1dd-411b-8ba2-ac8aa98ada96 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:43.585099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:43.586700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:43.666970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 518/1063] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:43.689668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:43.722633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79836bb0-c1dd-411b-8ba2-ac8aa98ada96 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:43.768078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:43.769363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.769803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.770296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.787975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:43.801713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:43.802797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:43.808409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 546/1064] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:43.811062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:43.845896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9389a5e-bf89-4dee-be90-d15840a25157 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:43.900860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:43.902158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.902973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.903387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.921540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:43.935907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:43.936966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:43.937880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:43.938544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 519/1065] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:43.946971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:43.952962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72963dab-ec88-4b89-bcc8-7e55b3020e55 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:43.993473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:43.994157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:43.994439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:43.994706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:43.995480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:43.995821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:43.997274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.006884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 547/1066] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:44.013902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.066240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9b2b-89d9-4cfb-8895-4e9e2c9e4474 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.116384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.117441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.117892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.118275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.119570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:44.120090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.122566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.136241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 520/1067] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:44.142620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.150291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c211a-a393-4f2a-927d-2ce8879cb92d None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.191636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.192692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.193104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.193512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] PATH_INFO: `/v3/users/dbc68d8a20344840b8a11f51ed5f3405` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.195241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc68d8a20344840b8a11f51ed5f3405)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.197863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.201136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 548/1068] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/users/dbc68d8a20344840b8a11f51ed5f3405 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:44.207915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.277990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d7df-1294-4c44-a27d-2f18635cf15d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.323280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.324071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4387e1-50c5-44c3-8f12-279dadf57fc1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.324546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.324959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.325339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.340448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.342143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-36c995cf-4815-448d-8fe2-402c35a37ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:44.360040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:44.367870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 521/1069] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af212-8e38-4c0d-abf4-263e7910cffb None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af212-8e38-4c0d-abf4-263e7910cffb None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af212-8e38-4c0d-abf4-263e7910cffb None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.369956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 522/1070] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:44.371360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13af212-8e38-4c0d-abf4-263e7910cffb None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.372157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.373036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.373308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.373575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.374778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.376285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7ca26-6bfa-45a9-b49e-b5fed0335a08 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.377998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 549/1071] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:44.380901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.381349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.381781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.400569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:44.401865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:44.473000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 550/1072] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:44.473932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.484904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13af212-8e38-4c0d-abf4-263e7910cffb None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.533271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.534305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.534648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.534984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.535924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:44.536302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.537911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.550577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 523/1073] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:44.551459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.591289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00281-21db-49cf-9fea-870575a256d8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.639341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.640657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.641092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.641520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2/users/dbc68d8a20344840b8a11f51ed5f3405/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.644606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] RBAC: Authorizing `identity:create_grant(project_id=f227e25dfb0b4965acf7f8a9873158a2, user_id=dbc68d8a20344840b8a11f51ed5f3405, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.646571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.666030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 551/1074] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:44 2022] PUT /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2/users/dbc68d8a20344840b8a11f51ed5f3405/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:44.666888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.697658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52f1b-a5ba-401b-bbf5-4d3be2157745 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.759004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.759916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.760407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.760870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.789882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db74aa1-8138-4507-a992-b318a48f435e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:44.836171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:44.837578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:44.838041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:44.838540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:44.853208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.856063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:44.876924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:44.878804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:44.880768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 552/1075] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:44.886886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:44.887809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:44.888467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.037714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 524/1076] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:45.044113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:45.052298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b846-6445-478d-ae30-4cb5d9dc2328 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.110329 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.111363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.111830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.112257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.113639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:45.114112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.116602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.153106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 553/1077] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:37:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:45.155062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:45.222431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0784a5-1f34-4895-9548-5dccddc6b9b2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.284653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.285478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.285764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.286038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.298654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.300200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.320314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ddd2e-1356-49dc-8c7d-bdd6ab42cfd3 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:45.320764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:45.322409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 525/1078] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:45.329361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:45.386188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.387573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.388098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.388576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.404575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.406758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:45.428662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:45.430466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:45.433040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:45.433040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:45.433040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:45.433040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:45.433040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 554/1079] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:45.440860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:45.478873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f509e0-c7e0-45c1-b53d-9747e806ed4a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.538485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.539555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.540021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.540458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.541899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:45.542236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.544650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.575823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 526/1080] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:45.603028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb12c7-c19c-4aef-9f2a-6010cfd0de8c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.669860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.671083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.671585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.672076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.673436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:45.673978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.676783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.701433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 555/1081] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:45.711070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:45.901623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bed8c-f00a-46b6-9681-c7ff546c146b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:45.961754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:45.963063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:45.963563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:45.964089 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:45.975931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:45.977691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:45.994346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:45.996225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:45.997557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 527/1082] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:46.007192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:46.177711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f43e7-0e49-41a0-85f1-f2bf51b54f40 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:46.236133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:46.237247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:46.237740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:46.238196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:46.239736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:46.240311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:46.243167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb3b47-da60-467e-80dc-0b8861b4f11b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:46.266116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 556/1083] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:46.275699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:46.391659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d953f-0d64-49df-98b0-50b0ae538b20 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:46.446206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:46.447176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:46.447546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:46.447966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/5940594e389c4022addcf8929b4eae81` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:46.450548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=d9052eeac18b49d79f81f1a3ec919c61, role_id=5940594e389c4022addcf8929b4eae81)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:46.452206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db45ae5-4556-408b-9739-c17475566625 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:46.469063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 528/1084] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:46 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/d9052eeac18b49d79f81f1a3ec919c61/roles/5940594e389c4022addcf8929b4eae81 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:37:47.077462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0f0-0e6c-4401-a4dd-7dc14e56bfa8 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.078296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0f0-0e6c-4401-a4dd-7dc14e56bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.078296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0f0-0e6c-4401-a4dd-7dc14e56bfa8 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:47.079739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 557/1085] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:47.086172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.086681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.087126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:47.114225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:47.116341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:47.239413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 529/1086] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:47.281199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32c0f0-0e6c-4401-a4dd-7dc14e56bfa8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:47.406832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32c0f0-0e6c-4401-a4dd-7dc14e56bfa8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:47.443785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:47.444716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.445084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.445448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:47.457512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:47.465384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:47.467316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:47.468986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 558/1087] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:47.475142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:47.584572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b997ac-7fce-4e5b-8599-2c6b713e1e25 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:47.622764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:47.623494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.623880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.624233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:47.625427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:47.625822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:47.627389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:47.637027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 530/1088] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:47.643584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:47.760712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b36b3f-649b-4c92-b93e-06b4974eee00 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:47.801217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:47.802208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.802532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.802849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] PATH_INFO: `/v3/users/dbc68d8a20344840b8a11f51ed5f3405` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:47.804493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] RBAC: Authorizing `identity:get_user(user_id=dbc68d8a20344840b8a11f51ed5f3405)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:47.806677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:47.808882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 559/1089] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:47 2022] GET /identity/v3/users/dbc68d8a20344840b8a11f51ed5f3405 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:47.815199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:47.927030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718f01-eb3f-4931-8526-cdc767eeb94c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:47.964114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:47.964877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:47.965248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:47.965610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:48.043133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:48.044774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:48.153966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 531/1090] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:48.160554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:48.273047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89478bc-53b9-4816-85b6-1381e1aa0b5f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:48.311468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:48.312557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:48.312928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:48.313312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:48.314849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:48.316479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c7c1-1009-4355-b1b9-5786ef2d01f4 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:48.318624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 560/1091] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:37:48 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:48.325314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:48.443320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b025cb5-8ffe-44b8-b75e-0c9eeefd7083 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:48.481794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:48.482583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:48.482951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:48.483372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:48.484591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=f227e25dfb0b4965acf7f8a9873158a2, user.id=dbc68d8a20344840b8a11f51ed5f3405) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:48.484990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:48.486583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137be713-7f78-4287-a959-5df619c1d54b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:48.494085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 532/1092] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:48 2022] GET /identity/v3/role_assignments?user.id=dbc68d8a20344840b8a11f51ed5f3405&scope.project.id=f227e25dfb0b4965acf7f8a9873158a2&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:48.814492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541d77-f80f-4e79-a291-d7ca78c21c68 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:48.814986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541d77-f80f-4e79-a291-d7ca78c21c68 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:48.815532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541d77-f80f-4e79-a291-d7ca78c21c68 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:48.818171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 561/1093] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:48.826483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:48.826972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:48.827372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:48.845877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:48.847199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:48.924812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 533/1094] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:48.949765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95541d77-f80f-4e79-a291-d7ca78c21c68 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:49.134349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95541d77-f80f-4e79-a291-d7ca78c21c68 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:49.195487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:49.196938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:49.197446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:49.197935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:49.217479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:37:49.234049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:49.235441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 14:37:49.236376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:49.237581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 562/1095] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 14:37:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:49.243939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:49.395274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c41b-fd06-4c99-9f42-ef8918886f4d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:49.437974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:49.438807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:49.439184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:49.439548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:49.440470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:49.440870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:49.442440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:49.452286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 534/1096] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:37:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:49.459136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:49.636652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531995-aaf3-4e5e-957f-fbd1a32b793b None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:49.700101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:49.701052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:49.701439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:49.701802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:49.715361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:49.717100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:49.736178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:49.738196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:49.744537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:49.744537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:49.744537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:49.744537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:49.744537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 563/1097] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:49.745083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:49.921643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257af4-4ecc-41d2-99f5-941eb2380c5e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:49.982094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:49.983114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:49.983567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:49.984149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:49.985485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:49.986018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:49.988683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:50.014652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 535/1098] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:50.021720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:50.153895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c7e5-4bd4-4447-b88f-498928366d8a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:50.193383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:50.194291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.194637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.194976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.204015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:50.205589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:37:50.221268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:50.223250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:37:50.225404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 564/1099] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 14:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:50.230797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:50.353954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b34a5-7b8c-4f53-92e0-cc8f2bace5fe None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:50.393218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:50.393959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.394277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.394583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.395508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:50.395914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:50.397516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:50.419968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 536/1100] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 14:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:50.428301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:50.552665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df95e0-6af1-4882-a9d3-afd556dadb97 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:50.589224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:50.590048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.590313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.590650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.665245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:50.666892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c6a02-c638-471a-b6c9-3248bb86f2bb None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:50.788424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 565/1101] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:50.790304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:50.901425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb594-6838-4011-9234-f1fc7a124d4a None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.901724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb594-6838-4011-9234-f1fc7a124d4a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.901967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb594-6838-4011-9234-f1fc7a124d4a None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.903792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 566/1102] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:37:50.909436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.909725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.910003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.919702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665b3d-aa6c-40b7-b100-9d74cea73f3c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:50.927359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:50.928626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:50.978589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:50.979988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:50.980453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:50.980933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:50.999271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.001316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.002618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 567/1103] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:37:51.021349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:51.023332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:51.025452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:37:51.025452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:37:51.025452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:37:51.025452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:51.027640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.028230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 537/1104] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:37:51.030877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.149892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddc50e-c9e8-4961-b9dc-5cc78330ffff None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.153227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8d235-73e6-4bac-a3a6-702e90227b11 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.188460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.189260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.189591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.189939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.190894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:51.191274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.191642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.192578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.192945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.193120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.193378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.194791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.196719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.198497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 568/1105] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:51.208171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.216631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 538/1106] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:37:51.217903 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.327162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476a58b-17c4-487c-b862-f79f00379094 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.334773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb18c80-c14c-497c-af67-611fee9d29a1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.377315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.378377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.378828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.379233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.380426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.381987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.385483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.386592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.386957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.387310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.396854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.399638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.409291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 569/1107] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:37:51 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:37:51.419876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:37:51.421977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:37:51.423825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 539/1108] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:37:51.428708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.550974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7ca8-4f9e-4fb1-9473-ec1777dc5bf6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.605751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.606903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.607363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.607871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.609454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:51.609986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.612864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee96d7-b813-43e3-89a6-9356fc7c342c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.637310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 570/1109] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:51.647597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:51.803937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a02ce-6a2b-4fa0-ad02-7de3bb38c366 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:51.840340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:51.841010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:51.841284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:51.841547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:51.842389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] RBAC: Adding query filter params (role.id=5940594e389c4022addcf8929b4eae81, scope.project.id=b3accb6964814c09a848544b57230884, user.id=d9052eeac18b49d79f81f1a3ec919c61) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:51.842692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:51.844215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac3d44-9773-44b9-9890-2948dde8a3df None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:51.851051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 540/1110] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:51 2022] GET /identity/v3/role_assignments?user.id=d9052eeac18b49d79f81f1a3ec919c61&scope.project.id=b3accb6964814c09a848544b57230884&role.id=5940594e389c4022addcf8929b4eae81 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:53.959444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0779-5fe3-42e9-9ba7-d41e53c201a8 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:53.960132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0779-5fe3-42e9-9ba7-d41e53c201a8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:53.960132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0779-5fe3-42e9-9ba7-d41e53c201a8 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:53.961562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 571/1111] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:53.967566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:53.968173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:53.968173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:53.986085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:53.987288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:54.056101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 541/1112] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:54.080273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c0779-5fe3-42e9-9ba7-d41e53c201a8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:54.186512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c0779-5fe3-42e9-9ba7-d41e53c201a8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:54.227880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:54.228821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:54.229194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:54.229563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] PATH_INFO: `/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:54.231320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] RBAC: Authorizing `identity:get_role(role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:54.232928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:54.234454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 572/1113] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:54 2022] GET /identity/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:54.243848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:54.358797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658eb11-a38e-4b9a-abcc-679de626e7a8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:54.396618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:54.397604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:54.397918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:54.398231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] PATH_INFO: `/v3/users/e01e6ab7fc1448ccb4be04e6f1418521` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:54.413822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] RBAC: Authorizing `identity:get_user(user_id=e01e6ab7fc1448ccb4be04e6f1418521)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:54.415418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:54.417295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 542/1114] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:54 2022] GET /identity/v3/users/e01e6ab7fc1448ccb4be04e6f1418521 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:54.423916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:54.535719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ccc2-102a-44f5-8aad-b14fb889e518 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:54.572165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:54.572891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:54.573209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:54.573505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:54.645249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:54.646792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:54.752347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 573/1115] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:37:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:37:54.758827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:54.902882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4a88-3bc7-4e8d-bf90-c9db8b56c61a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:54.964102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:54.965475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:54.965914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:54.966354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:54.968542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:54.971215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb8f28-5d13-4615-b12b-9e0b65b77e5a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:54.974536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 543/1116] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:37:54 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:54.984480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:55.091932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338466-1ccc-4960-b122-83c9efb68664 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:55.131174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:55.131933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:55.132254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:55.132563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:55.133443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=f227e25dfb0b4965acf7f8a9873158a2, user.id=e01e6ab7fc1448ccb4be04e6f1418521) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:37:55.133794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:55.135275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed01a9-42f6-49e3-8cfb-bfffa8b0e81c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:55.141259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 574/1117] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:37:54 2022] GET /identity/v3/role_assignments?user.id=e01e6ab7fc1448ccb4be04e6f1418521&scope.project.id=f227e25dfb0b4965acf7f8a9873158a2&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:57.458007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08079d0-da98-4440-bfe4-6fae66d5fb62 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:57.458623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08079d0-da98-4440-bfe4-6fae66d5fb62 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:57.458623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08079d0-da98-4440-bfe4-6fae66d5fb62 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:57.460290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 544/1118] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:37:57.466709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:57.467308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:57.467308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:57.485893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:37:57.487142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:37:57.565504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 575/1119] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:37:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:37:57.589260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08079d0-da98-4440-bfe4-6fae66d5fb62 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:57.697509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08079d0-da98-4440-bfe4-6fae66d5fb62 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:57.733550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:57.734538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:57.734863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:57.735183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] PATH_INFO: `/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:57.736761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] RBAC: Authorizing `identity:get_role(role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:57.738241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:57.739731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 545/1120] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:57 2022] GET /identity/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:57.749842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:57.897365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f54f2-cbd0-4641-b8ef-1242fc3e7d5c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:57.936451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:57.937536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:57.937904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:57.938269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] PATH_INFO: `/v3/users/e01e6ab7fc1448ccb4be04e6f1418521` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:57.939935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] RBAC: Authorizing `identity:get_user(user_id=e01e6ab7fc1448ccb4be04e6f1418521)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:57.941262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:57.943024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 576/1121] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:37:57 2022] GET /identity/v3/users/e01e6ab7fc1448ccb4be04e6f1418521 => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:57.949659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:58.061061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c9c8-7249-4623-8276-d25b19b49933 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:58.097891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:58.098787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:58.099054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:58.099320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:58.100632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:58.102102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05144726-8721-4d8e-907f-c619f9e2d1c9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:58.104254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 546/1122] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:37:57 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:37:58.111060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:37:58.219439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684d2b2-cb08-49fb-9603-4aaf31c98bea None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:37:58.262917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:37:58.266143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:37:58.266522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:37:58.266803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2/users/e01e6ab7fc1448ccb4be04e6f1418521/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:37:58.270194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f227e25dfb0b4965acf7f8a9873158a2, user_id=e01e6ab7fc1448ccb4be04e6f1418521, role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:37:58.271906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b54807-15e4-4f0d-87a0-5e179c07dbb2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:37:58.288827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 577/1123] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:37:58 2022] PUT /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2/users/e01e6ab7fc1448ccb4be04e6f1418521/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:38:00.570662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47e1d-8456-43ed-9dd3-26a8f8a129c5 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:00.571263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47e1d-8456-43ed-9dd3-26a8f8a129c5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:00.571263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47e1d-8456-43ed-9dd3-26a8f8a129c5 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:00.572760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 547/1124] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:00.579002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:00.579591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:00.579591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:00.598813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:00.600094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:00.684870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 578/1125] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:00.710192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47e1d-8456-43ed-9dd3-26a8f8a129c5 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:00.832027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47e1d-8456-43ed-9dd3-26a8f8a129c5 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:00.877912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:00.878685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:00.878960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:00.879229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] PATH_INFO: `/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:00.880814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] RBAC: Authorizing `identity:get_role(role_id=c5d282ae7f1c4281a91acef5be4ee73b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:00.882235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:00.883656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 548/1126] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:00 2022] GET /identity/v3/roles/c5d282ae7f1c4281a91acef5be4ee73b => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:38:00.890209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:00.999189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249fa00-9939-4a1d-bf1e-d77dfbf053ba None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:01.044277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:01.045771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:01.046359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:01.046819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] PATH_INFO: `/v3/users/e01e6ab7fc1448ccb4be04e6f1418521` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:01.048885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e01e6ab7fc1448ccb4be04e6f1418521)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:01.051539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:01.054600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 579/1127] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:00 2022] GET /identity/v3/users/e01e6ab7fc1448ccb4be04e6f1418521 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:01.060883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:01.175076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821cd0-f73e-437a-9e99-7ebced9f6e8d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:01.213890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:01.214548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:01.214831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:01.215098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:01.288006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:01.289510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:01.394041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 549/1128] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 14:38:01.400791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:01.510380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a5a87-72a6-4c94-b777-c3c483a000e2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:01.546214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:01.547082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:01.547358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:01.547611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] PATH_INFO: `/v3/projects/f227e25dfb0b4965acf7f8a9873158a2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:01.548899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] RBAC: Authorizing `identity:get_project(project_id=f227e25dfb0b4965acf7f8a9873158a2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:01.550367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e783a69-6568-4d09-b5b5-6b2918a32204 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:01.552175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 580/1129] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:01 2022] GET /identity/v3/projects/f227e25dfb0b4965acf7f8a9873158a2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:01.558827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:01.667227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f54e-cb78-4902-91eb-543d2100aa15 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:01.705663 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:01.706303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:01.706577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:01.706845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:01.707700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] RBAC: Adding query filter params (role.id=c5d282ae7f1c4281a91acef5be4ee73b, scope.project.id=f227e25dfb0b4965acf7f8a9873158a2, user.id=e01e6ab7fc1448ccb4be04e6f1418521) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:01.708025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:01.709532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55dc84-8aa9-4404-b641-f6dbc289b825 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:01.716388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 550/1130] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:38:01 2022] GET /identity/v3/role_assignments?user.id=e01e6ab7fc1448ccb4be04e6f1418521&scope.project.id=f227e25dfb0b4965acf7f8a9873158a2&role.id=c5d282ae7f1c4281a91acef5be4ee73b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:04.202413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ba33-4b1c-491b-ab24-487c2047ebc1 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:04.203030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ba33-4b1c-491b-ab24-487c2047ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:04.203030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ba33-4b1c-491b-ab24-487c2047ebc1 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:04.204597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 581/1131] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:04.210653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:04.211202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:04.211202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:04.229278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:04.230471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:04.303410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 551/1132] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:04.328071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0ba33-4b1c-491b-ab24-487c2047ebc1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:04.452201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0ba33-4b1c-491b-ab24-487c2047ebc1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:04.492038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:04.492763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:04.493042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:04.493304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:04.494749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:04.496296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c32b-23c8-46c0-ae50-8337580ecc72 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:04.498050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 582/1133] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:38:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:04.504790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:04.618262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28271f1-1087-4542-8426-567f8dcf18ed None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:04.660494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:04.661177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:04.661455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:04.661728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:04.662451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:04.663978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fab2b8-755c-4391-96c1-f3c361b40575 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:04.694185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 552/1134] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:38:04 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:38:07.165396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551c0b-1e46-4390-8c5d-c0d62ca6aa2c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:07.166600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551c0b-1e46-4390-8c5d-c0d62ca6aa2c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:07.166930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551c0b-1e46-4390-8c5d-c0d62ca6aa2c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:07.168563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 583/1135] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:07.178162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:07.178899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:07.179095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:07.198263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:07.199495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:07.271273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 553/1136] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:07.297167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73551c0b-1e46-4390-8c5d-c0d62ca6aa2c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:07.413135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73551c0b-1e46-4390-8c5d-c0d62ca6aa2c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:07.449111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:07.449884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:07.450205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:07.450518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:07.451830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:07.453406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509f45-3d89-401b-97fa-3459021581b6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:07.455098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 584/1137] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:38:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:07.461348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:07.569174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe97d2-a542-4653-9917-ce24f0fe8412 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:07.609607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:07.610299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:07.610573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:07.610839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:07.611568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:07.613144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7825-3229-4abb-b223-c6f34133012b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:07.636263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 554/1138] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:38:07 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:38:10.034622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4383d1-77b5-43e4-bcc0-15959e8bff59 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.035194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4383d1-77b5-43e4-bcc0-15959e8bff59 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.035194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4383d1-77b5-43e4-bcc0-15959e8bff59 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.036594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 585/1139] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:10.045198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.045750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.045750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.063995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:10.065227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:10.137409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 555/1140] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:10.162776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4383d1-77b5-43e4-bcc0-15959e8bff59 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:10.337690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4383d1-77b5-43e4-bcc0-15959e8bff59 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:10.382716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:10.383525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.383830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.384103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.395836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:10.403998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:10.405922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:10.407633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 586/1141] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:38:10.412109 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:10.525265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22604ad4-8e8f-4d4a-b047-87dd5ba3d97d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:10.565175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:10.565863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.566144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.566417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.567181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:10.567484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:10.568993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:10.578759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 556/1142] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:10.585264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:10.709301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf28f-a0bc-4b21-bf74-8c6aa91f4bed None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:10.745471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:10.746356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.746639 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.746911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] PATH_INFO: `/v3/users/6b58d60fd9bf454187af98829724c8e7` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.762102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] RBAC: Authorizing `identity:get_user(user_id=6b58d60fd9bf454187af98829724c8e7)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:10.763602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:10.765496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 587/1143] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:10 2022] GET /identity/v3/users/6b58d60fd9bf454187af98829724c8e7 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:10.771941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:10.886273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390932-7f38-4cfa-b446-aa7a8417d77e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:10.921849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:10.922522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:10.922793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:10.923066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:10.996374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:10.997796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:11.099028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 557/1144] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:38:11.105581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:11.206772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6625f-ec00-4d12-b41c-18e0d748baca None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:11.247897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:11.248699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:11.249022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:11.249326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] PATH_INFO: `/v3/projects/1113882d552a448abbb7f437e7844550` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:11.250556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] RBAC: Authorizing `identity:get_project(project_id=1113882d552a448abbb7f437e7844550)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:11.252269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303c498-fe1f-4a42-89bd-950f719fdf4b None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:11.254769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 588/1145] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:11 2022] GET /identity/v3/projects/1113882d552a448abbb7f437e7844550 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:11.262164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:11.377071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac04a1-735f-41a9-85f5-9728f5412e9c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:11.415509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:11.416227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:11.416509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:11.416779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:11.417650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=1113882d552a448abbb7f437e7844550, user.id=6b58d60fd9bf454187af98829724c8e7) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:11.417963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:11.419516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744c52b-ac75-470e-93e0-3938e3ccf3c5 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:11.426263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 558/1146] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:38:11 2022] GET /identity/v3/role_assignments?user.id=6b58d60fd9bf454187af98829724c8e7&scope.project.id=1113882d552a448abbb7f437e7844550&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:13.712933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169159d-8dca-4ec2-a3b3-717126189a27 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:13.713587 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169159d-8dca-4ec2-a3b3-717126189a27 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:13.713587 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169159d-8dca-4ec2-a3b3-717126189a27 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:13.715057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 589/1147] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:13.721629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:13.722250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:13.722250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:13.740593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:13.741810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:13.815049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 559/1148] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:13.838876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169159d-8dca-4ec2-a3b3-717126189a27 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:13.959579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169159d-8dca-4ec2-a3b3-717126189a27 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:13.997608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:13.998338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:13.998629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:13.998973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:14.010175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:14.017964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:14.019859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:14.021791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 590/1149] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:38:14.027653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:14.128962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ae21-c671-4af3-91eb-9868635f95c8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:14.165981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:14.166659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:14.166940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:14.167208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:14.168004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:14.168309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:14.169711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:14.179225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 560/1150] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:14.185677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:14.325084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80f34-adcd-4fb2-80e7-b8b5b0431a85 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:14.362449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:14.363380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:14.363659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:14.363957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] PATH_INFO: `/v3/users/6b58d60fd9bf454187af98829724c8e7` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:14.365264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] RBAC: Authorizing `identity:get_user(user_id=6b58d60fd9bf454187af98829724c8e7)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:14.366719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:14.368442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 591/1151] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:14 2022] GET /identity/v3/users/6b58d60fd9bf454187af98829724c8e7 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:14.374712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:14.497304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831dbd-20b6-441d-92c5-f2985ae112d7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:14.534429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:14.535407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:14.535742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:14.536098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] PATH_INFO: `/v3/projects/1113882d552a448abbb7f437e7844550` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:14.537408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] RBAC: Authorizing `identity:get_project(project_id=1113882d552a448abbb7f437e7844550)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:14.538972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9b54b-bb6a-46fa-afa3-caed67ff0d26 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:14.540821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 561/1152] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:14 2022] GET /identity/v3/projects/1113882d552a448abbb7f437e7844550 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:38:14.547516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:14.654572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d619-f5ab-4435-98c1-b845b261c482 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:14.692754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:14.693673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:14.693956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:14.694283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] PATH_INFO: `/v3/projects/1113882d552a448abbb7f437e7844550/users/6b58d60fd9bf454187af98829724c8e7/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:14.696405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] RBAC: Authorizing `identity:create_grant(project_id=1113882d552a448abbb7f437e7844550, user_id=6b58d60fd9bf454187af98829724c8e7, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:14.697870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39507031-50a1-445d-9a5b-c69ca52c5486 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:14.713228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 592/1153] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:38:14 2022] PUT /identity/v3/projects/1113882d552a448abbb7f437e7844550/users/6b58d60fd9bf454187af98829724c8e7/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:38:17.066589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac7e8-4ba2-41fb-9cc6-1352ab90135d None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.067207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac7e8-4ba2-41fb-9cc6-1352ab90135d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.067207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac7e8-4ba2-41fb-9cc6-1352ab90135d None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.068734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 562/1154] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:17.074842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.075442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.075442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.093455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:17.094696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:17.172448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 593/1155] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:38:17.196594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac7e8-4ba2-41fb-9cc6-1352ab90135d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:17.307174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac7e8-4ba2-41fb-9cc6-1352ab90135d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:17.347936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:17.348753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.349032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.349300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.365860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:17.381022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:17.382306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:17.383374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:38:17.387888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 563/1156] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:38:17.393028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:17.502450 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654288-145f-4b9c-a3cf-097ac2390629 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:17.543942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:17.544643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.544924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.545187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.546051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:17.546356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:17.547855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:17.557207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 594/1157] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:17.563798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:17.679950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0601fd-a1d7-48c0-84f9-1a8afa43c451 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:17.720833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:17.721709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.721988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.722255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] PATH_INFO: `/v3/users/6b58d60fd9bf454187af98829724c8e7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.723581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] RBAC: Authorizing `identity:get_user(user_id=6b58d60fd9bf454187af98829724c8e7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:17.725129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:17.726860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 564/1158] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:17 2022] GET /identity/v3/users/6b58d60fd9bf454187af98829724c8e7 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:17.736376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:17.851835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25dd20-ba7c-448a-bab6-9814385824c2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:17.895144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:17.895144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:17.895144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:17.895144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:17.963793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:17.965174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:18.079658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 595/1159] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:38:18.086140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:18.210115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe3c6-45f0-4a39-88df-e05e6f336745 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:18.250103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:18.251073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:18.251434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:18.251852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] PATH_INFO: `/v3/projects/1113882d552a448abbb7f437e7844550` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:18.253338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] RBAC: Authorizing `identity:get_project(project_id=1113882d552a448abbb7f437e7844550)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:18.254836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d85d-ac1c-42a8-bf52-0382b6b3947d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:18.256720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 565/1160] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:18 2022] GET /identity/v3/projects/1113882d552a448abbb7f437e7844550 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:18.263276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:18.375497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9bdd-5287-488a-aa74-3471fac8f39f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:18.412948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:18.413644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:18.413920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:18.414186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:18.415024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=1113882d552a448abbb7f437e7844550, user.id=6b58d60fd9bf454187af98829724c8e7) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:18.415332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:18.416838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af4927-9ea7-4dc6-82e6-ee8c75309c05 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:18.423917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 596/1161] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:38:18 2022] GET /identity/v3/role_assignments?user.id=6b58d60fd9bf454187af98829724c8e7&scope.project.id=1113882d552a448abbb7f437e7844550&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:20.768344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2afe-8315-4943-a010-db3cb71c197d None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:20.768917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2afe-8315-4943-a010-db3cb71c197d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:20.768917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2afe-8315-4943-a010-db3cb71c197d None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:20.770444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 566/1162] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:20.776851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:20.777892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:20.777892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:20.796813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:20.798075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:20.876391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 597/1163] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:20.899438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b2afe-8315-4943-a010-db3cb71c197d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:21.023888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b2afe-8315-4943-a010-db3cb71c197d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:21.062619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:21.063292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:21.063570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:21.063877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:21.148177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:21.151018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:21.323877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 567/1164] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 14:38:21.333624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:21.509119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19208e2-973a-4f59-93aa-f9561037d175 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:21.568630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:21.569990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:21.570475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:21.570935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:21.583691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:21.586304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-eefcebf9-9368-4127-8fc4-4451ce885719 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:21.614243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:21.615984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 14:38:21.617591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:21.619852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 598/1165] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:38:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:38:21.625716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:21.747079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f58a2-4042-475e-807d-19a4f32e8ff1 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:21.784762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:21.785515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:21.785653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:21.785960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:21.786692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:21.786998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:21.788435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307f2b5-5bd4-42f5-a204-b008952c4c81 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:21.796712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 568/1166] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 14:38:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:24.166444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369c02-c555-44a4-ad5a-85dba8357d51 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:24.166994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369c02-c555-44a4-ad5a-85dba8357d51 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:24.167085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369c02-c555-44a4-ad5a-85dba8357d51 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:24.168622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 599/1167] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:24.175954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c011-f4d3-4023-b3c9-e0d2f0f3a133 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:24.176556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c011-f4d3-4023-b3c9-e0d2f0f3a133 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:24.176866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c011-f4d3-4023-b3c9-e0d2f0f3a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:24.204532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ca96c011-f4d3-4023-b3c9-e0d2f0f3a133 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:24.206523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ca96c011-f4d3-4023-b3c9-e0d2f0f3a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:24.322330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 569/1168] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:24.348612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369c02-c555-44a4-ad5a-85dba8357d51 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:24.461645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369c02-c555-44a4-ad5a-85dba8357d51 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:24.505551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:24.506239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:24.506523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:24.506793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:24.507534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:24.508973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5f845-1175-42e3-9a3a-d592d050ea52 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:24.526081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 600/1169] 10.222.0.21 () {60 vars in 1138 bytes} [Wed May 4 14:38:24 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:38:26.873278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134dc5-206d-4522-abdc-909e873af495 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:26.873915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134dc5-206d-4522-abdc-909e873af495 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:26.873915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134dc5-206d-4522-abdc-909e873af495 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:26.875381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 570/1170] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:38:26.884703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:26.885284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:26.885284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:26.904962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:26.906194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:26.984266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 601/1171] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:27.008904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134dc5-206d-4522-abdc-909e873af495 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:27.120930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134dc5-206d-4522-abdc-909e873af495 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:27.161452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:27.162336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:27.162605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:27.162871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] PATH_INFO: `/v3/domains/3725ba5188664bbfabb2886e2574043f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:27.174365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3725ba5188664bbfabb2886e2574043f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:27.175908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117df93c-5e14-4a04-8fb1-0e31cdb76ed6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:27.177700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 571/1172] 10.222.0.21 () {56 vars in 1183 bytes} [Wed May 4 14:38:27 2022] GET /identity/v3/domains/3725ba5188664bbfabb2886e2574043f => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:27.184198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:27.294680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8be5-f48e-4fe7-850f-9df8bdc91a33 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:27.335115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:27.335831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:27.336111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:27.336371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:27.337247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:27.338617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a39e9-5fdc-4539-8ca5-53f8a7ab87c8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:27.372070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 602/1173] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:38:27 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:38:29.698608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6b912-532e-48a7-b80c-f3408dea5f49 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:29.699237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6b912-532e-48a7-b80c-f3408dea5f49 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:29.699237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6b912-532e-48a7-b80c-f3408dea5f49 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:29.700851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 572/1174] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:29.706797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:29.707389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:29.707389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:29.725198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:29.726391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:29.796047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 603/1175] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:38:29.821174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6b912-532e-48a7-b80c-f3408dea5f49 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:29.926865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6b912-532e-48a7-b80c-f3408dea5f49 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:29.962716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:29.963508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:29.963820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:29.964094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] PATH_INFO: `/v3/domains/3725ba5188664bbfabb2886e2574043f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:29.965290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3725ba5188664bbfabb2886e2574043f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:29.966808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267d4f-ade1-4571-8af2-a3e28c887077 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:29.968737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 573/1176] 10.222.0.21 () {56 vars in 1183 bytes} [Wed May 4 14:38:29 2022] GET /identity/v3/domains/3725ba5188664bbfabb2886e2574043f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:38:29.974902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:30.080601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490b6d-e38a-4468-a5cf-f37445c77852 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:30.118709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:30.119494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:30.119869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:30.120184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:30.121001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:30.122580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb297e88-77b4-476e-afd0-bb5dd49348ec None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:30.146901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 604/1177] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:38:29 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:38:32.534019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb3ead-60c7-46d0-9637-24347ae86485 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:32.534629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb3ead-60c7-46d0-9637-24347ae86485 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:32.534629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb3ead-60c7-46d0-9637-24347ae86485 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:32.536083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 574/1178] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:32.542207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:32.542731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:32.542731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:32.561533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:32.562731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:32.633225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 605/1179] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:32.657452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb3ead-60c7-46d0-9637-24347ae86485 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:32.768177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb3ead-60c7-46d0-9637-24347ae86485 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:32.802957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:32.803953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:32.804315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:32.804669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:32.822610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:32.830747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:32.832622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:38:32.834600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 575/1180] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:38:32.840677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:32.950186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adf86b-ad23-414b-a3d2-cf18837fad3f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:32.989530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:32.990298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:32.990620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:32.990928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:32.991813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:32.992164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:32.993634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:33.004123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 606/1181] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:33.010645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:33.116220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75d0a-8e4e-4953-9b94-93af2bc2fc05 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:33.152872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:33.153780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:33.154096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:33.154386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] PATH_INFO: `/v3/users/ecc577d169254c17aa29a63a18b07747` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:33.167924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] RBAC: Authorizing `identity:get_user(user_id=ecc577d169254c17aa29a63a18b07747)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:33.169489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:33.171336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 576/1182] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:33 2022] GET /identity/v3/users/ecc577d169254c17aa29a63a18b07747 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:33.183111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:33.285470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066207c3-781c-411d-b7a1-b8e766672990 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:33.320754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:33.321386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:33.321661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:33.321961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:33.395814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:33.397338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:33.506868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 607/1183] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:38:33.513204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:33.619111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3722-ccf1-49ab-9e30-ad7054f29b4c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:33.654335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:33.655252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:33.655527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:33.655821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] PATH_INFO: `/v3/projects/347cdbd6c52b46348a3b5e2726c476d2` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:33.657188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] RBAC: Authorizing `identity:get_project(project_id=347cdbd6c52b46348a3b5e2726c476d2)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:33.658698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4781c2d-bdd7-489e-9be7-78bebd1ab1ec None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:33.660534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 577/1184] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:33 2022] GET /identity/v3/projects/347cdbd6c52b46348a3b5e2726c476d2 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:33.667310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:33.768402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1d3c-d6cc-4a50-a27a-d619cda36b7c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:33.804139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:33.804802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:33.805081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:33.805355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:33.806192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=347cdbd6c52b46348a3b5e2726c476d2, user.id=ecc577d169254c17aa29a63a18b07747) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:33.806498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:33.807983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d730-2437-4adb-8d47-d67038e520f2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:33.813590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 608/1185] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:38:33 2022] GET /identity/v3/role_assignments?user.id=ecc577d169254c17aa29a63a18b07747&scope.project.id=347cdbd6c52b46348a3b5e2726c476d2&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:36.178289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c144-086b-4880-ac8c-18480f2fe30e None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.178848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c144-086b-4880-ac8c-18480f2fe30e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.178848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c144-086b-4880-ac8c-18480f2fe30e None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.180240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 578/1186] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:36.186192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.186646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.186722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.204305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:36.205516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:36.275281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 609/1187] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:38:36.298793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1c144-086b-4880-ac8c-18480f2fe30e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:36.409840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1c144-086b-4880-ac8c-18480f2fe30e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:36.444568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:36.445278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.445557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.445826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.456358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:36.464299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:36.465370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:38:36.466261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 579/1188] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:38:36.472316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:36.574921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34166-d96f-4531-9aa6-e798bb28b65c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:36.611690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:36.612391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.612675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.612948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.613702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:36.614006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:36.615399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:36.624456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 610/1189] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:36.631839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:36.741657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547fc0-3c4f-461c-865d-e0f56077c998 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:36.778282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:36.779150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.779501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.779802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] PATH_INFO: `/v3/users/ecc577d169254c17aa29a63a18b07747` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.781033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] RBAC: Authorizing `identity:get_user(user_id=ecc577d169254c17aa29a63a18b07747)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:36.782526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:36.784250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 580/1190] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:36 2022] GET /identity/v3/users/ecc577d169254c17aa29a63a18b07747 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:36.790569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:36.894089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db51-43f4-4e7a-b92d-d782f6398ea1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:36.932520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:36.933378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:36.933658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:36.933929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] PATH_INFO: `/v3/projects/347cdbd6c52b46348a3b5e2726c476d2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:36.935186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] RBAC: Authorizing `identity:get_project(project_id=347cdbd6c52b46348a3b5e2726c476d2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:36.936851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7dd7-440a-4090-a463-eaf768a25018 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:36.938824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 611/1191] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:36 2022] GET /identity/v3/projects/347cdbd6c52b46348a3b5e2726c476d2 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:36.944855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:37.056769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47a74-eb16-4a2a-9f0f-290a6ff8bcee None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:37.091865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:37.092788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:37.093036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:37.093339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] PATH_INFO: `/v3/projects/347cdbd6c52b46348a3b5e2726c476d2/users/ecc577d169254c17aa29a63a18b07747/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:37.095388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] RBAC: Authorizing `identity:create_grant(project_id=347cdbd6c52b46348a3b5e2726c476d2, user_id=ecc577d169254c17aa29a63a18b07747, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:37.096928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905dfe2-0ee3-4ea8-a106-d2fa3c80ee3a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:37.111517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 581/1192] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:38:36 2022] PUT /identity/v3/projects/347cdbd6c52b46348a3b5e2726c476d2/users/ecc577d169254c17aa29a63a18b07747/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:38:39.442679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1816e-a364-433f-b7ae-a864c2d6d028 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:39.443312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1816e-a364-433f-b7ae-a864c2d6d028 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:39.443312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1816e-a364-433f-b7ae-a864c2d6d028 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:39.444618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 612/1193] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:38:39.450360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:39.450875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:39.450875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:39.469406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:38:39.470703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:38:39.589911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 582/1194] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:38:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:38:39.614123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1816e-a364-433f-b7ae-a864c2d6d028 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:39.740312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1816e-a364-433f-b7ae-a864c2d6d028 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:39.778213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:39.779070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:39.779726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:39.779856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:39.791434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:38:39.799331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:38:39.801263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:38:39.803091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 613/1195] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:38:39.808088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:39.922686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0f196-2a5b-4bda-8c28-b4b01968ddfa None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:39.962308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:39.963022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:39.963303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:39.963571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:39.964378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:39.964686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:39.966178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:39.976377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 583/1196] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:39.983484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:40.172006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb27dfe-26eb-434d-8b20-b71e6005fe0f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:40.227874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:40.229297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:40.229780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:40.230266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] PATH_INFO: `/v3/users/ecc577d169254c17aa29a63a18b07747` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:40.232427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc577d169254c17aa29a63a18b07747)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:40.235033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:40.238242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 614/1197] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 14:38:39 2022] GET /identity/v3/users/ecc577d169254c17aa29a63a18b07747 => generated 311 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:40.245025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:40.377681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ba65-face-4027-9e39-5c40b9b96758 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:40.413665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:40.414365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:40.414733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:40.415053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:40.485674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:40.487168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:40.590792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 584/1198] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:38:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:38:40.597360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:40.700298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2a23-01af-48b4-82b4-0af23cf1e252 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:40.735954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:40.736797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:40.737123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:40.737441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] PATH_INFO: `/v3/projects/347cdbd6c52b46348a3b5e2726c476d2` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:40.738745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] RBAC: Authorizing `identity:get_project(project_id=347cdbd6c52b46348a3b5e2726c476d2)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:40.740293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb60a-2f44-4d3b-861a-18ed19820553 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:40.742122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 615/1199] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 14:38:40 2022] GET /identity/v3/projects/347cdbd6c52b46348a3b5e2726c476d2 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:38:40.748870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:38:40.858840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e160e-2ab3-4818-b0d0-e92b7bde5821 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:38:40.918854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:38:40.920007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:38:40.920513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:38:40.920992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:38:40.922466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=347cdbd6c52b46348a3b5e2726c476d2, user.id=ecc577d169254c17aa29a63a18b07747) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:38:40.923009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:38:40.925760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849be7c-a4cd-4aff-b355-f1e84ab5dc9b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:38:40.937041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 585/1200] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:38:40 2022] GET /identity/v3/role_assignments?user.id=ecc577d169254c17aa29a63a18b07747&scope.project.id=347cdbd6c52b46348a3b5e2726c476d2&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:39:45.546160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfab07-99db-49fb-9172-17d2344eb762 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:45.546160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfab07-99db-49fb-9172-17d2344eb762 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:45.546160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfab07-99db-49fb-9172-17d2344eb762 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:45.546160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 616/1201] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:39:45.554475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:45.555188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:45.555188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:45.581603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:39:45.583584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:39:45.691713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 586/1202] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:39:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:39:45.719535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfab07-99db-49fb-9172-17d2344eb762 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:45.891113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfab07-99db-49fb-9172-17d2344eb762 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:45.944923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:45.946025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:45.946508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:45.947004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:45.966286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:45.969162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:45.992024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:45.993862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:45.995376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:45.995376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:45.995376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:45.995376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:39:45.999035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 617/1203] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:46.000908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:46.145579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2ece-54d1-4a80-985e-db4589158855 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:46.205875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:46.207013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:46.207496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:46.208006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:46.209383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:46.209931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:46.212735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98703bc8-3c57-4b01-a32b-cb7d9fdc7d13 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:46.231061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 587/1204] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:46.237921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:46.407387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac03d4-5a5a-4cfc-bc84-1a33aa4ad63f None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:46.478020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:46.478550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:46.478839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:46.479097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:46.479836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:46.481573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19fac-4405-443d-8fa9-eb02f01cb226 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:46.519721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 618/1205] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 14:39:46 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:39:49.272731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4da4-d48f-489c-af94-804301494b1d None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:49.273348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4da4-d48f-489c-af94-804301494b1d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:49.273524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4da4-d48f-489c-af94-804301494b1d None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:49.274775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 588/1206] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:39:49.283558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:49.284560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:49.284761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:49.312661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:39:49.314501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:39:49.407142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 619/1207] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:39:49.432137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4da4-d48f-489c-af94-804301494b1d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:49.552764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4da4-d48f-489c-af94-804301494b1d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:49.598169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:49.599049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:49.599332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:49.599641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:49.619893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:39:49.628052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:49.629231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:49.630254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 589/1208] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:39:49.636427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:49.761154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3947e6-5bda-48fe-86df-c3cd7af49a91 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:49.800779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:49.801481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:49.801795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:49.802230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:49.803193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:49.803501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:49.805414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:49.815423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 620/1209] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:49.822301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:49.938839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cb37-ef46-44cd-b649-f6c3c6522f20 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:49.977131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:49.978088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:49.978370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:49.978652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:49.990780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:49.991877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:50.010905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:50.012065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:50.013018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:50.013018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:50.013018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:50.013018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:50.013018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 590/1210] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:50.018469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:50.136818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b94b-40ff-4525-8887-256a0994587c None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:50.178731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:50.179528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:50.179881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:50.180125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:50.180952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:50.181257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:50.182735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:50.202163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 621/1211] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:50.208731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:50.323890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4fc78-3dd5-4ac3-b935-cb487e298387 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:50.366950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:50.369221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:50.369433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:50.369747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:50.378413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:50.381292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:39:50.398549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:50.399929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:39:50.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:50.402682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 591/1212] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:50.408611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:50.550596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d602-5532-4bee-bb9b-59b428b0a813 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:50.596457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:50.597514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:50.597959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:50.598370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:50.600101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:50.600741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:50.602916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:50.625581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 622/1213] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:39:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:50.632761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:50.767736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbabe6-b008-4f48-a299-180cf413e54b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:50.811529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:50.812370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:50.812781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:50.813158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:50.896275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:50.897828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:51.047963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 592/1214] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:39:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 14:39:51.052853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:51.188880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206a974-2376-456e-a046-fa6d496fd652 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:51.233997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:51.235104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:51.235301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:51.235459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:51.247229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:51.248864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:51.268900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:51.270900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:51.272714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:51.272714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:51.272714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:51.272714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:39:51.272714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 623/1215] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:51.279714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:51.421961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be990d-731d-4642-85eb-af668b4d2e6a None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:51.469844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:51.470541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:51.471414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:51.471414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:51.471930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:51.472237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:51.473820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:51.488546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 593/1216] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:51.493395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:51.631905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c0f6-7469-4719-a375-22b6a70164a2 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:51.674490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:51.675492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:51.675918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:51.676347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:51.685090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:51.686737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:39:51.702929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:51.704019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:39:51.704941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 624/1217] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:39:51.716116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:51.884179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42253-c177-49d8-b557-ac33ff9523d9 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:51.928739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:51.929561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:51.930363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:51.930363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:51.931493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:51.931828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:51.933404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ada9e-8676-40ab-846b-4ff595ab179b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:51.948097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 594/1218] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:51.954427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:52.078326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5bb7-81ed-4987-9813-c3302d7bca48 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:52.120184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:52.121668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:52.121668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:52.121668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:52.122294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:52.122604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:52.124154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf575db-be92-43f7-af0b-3fa0eb656e4c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:52.132314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 625/1219] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:39:51 2022] GET /identity/v3/role_assignments?user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:54.493419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dcfd-dbad-44ee-821a-4972c2266ce2 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:54.493990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dcfd-dbad-44ee-821a-4972c2266ce2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:54.493990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dcfd-dbad-44ee-821a-4972c2266ce2 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:54.495326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 595/1220] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:39:54.501468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:54.501960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:54.502053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:54.520862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:39:54.522091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:39:54.618586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 626/1221] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:39:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:39:54.641829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787dcfd-dbad-44ee-821a-4972c2266ce2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:54.765601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787dcfd-dbad-44ee-821a-4972c2266ce2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:54.821017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:54.822012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:54.822467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:54.822800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:54.838923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:39:54.848632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:54.850058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:54.851217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 596/1222] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:39:54.856767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:54.970586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bedf7-cf65-42cd-af9a-7dc96158f81d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.012447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.013160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.013454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.013740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.014486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] RBAC: Adding query filter params (name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:55.014808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.016326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.026870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 627/1223] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:55.033355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:55.148873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa60c-0d51-468a-9244-3405060fb5c6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.186153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.186153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.186544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.186840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.199620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.201170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:55.219171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:55.220468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:55.221475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:55.221475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:55.221475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:55.221475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:55.221475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 597/1224] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:39:55.226806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:55.369014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9bbda-05c1-413c-8023-48fdce93d691 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.406145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.406824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.407100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.407371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.408190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:55.408539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.410145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.425038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 628/1225] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:55.431137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:55.543648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e94d9-6005-4ae0-a91f-e3e7ec75deb6 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.579445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.580282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.580558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.580975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.589130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.590762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:39:55.605140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:55.606700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:55.607771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 598/1226] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:55.613055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:55.723221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e60d-8715-48e2-97b0-7e9bafd0d1fa None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.762429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.763105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.763430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.763753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.764745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:55.765230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.766677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.785603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 629/1227] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:55.791852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:55.910027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642dae-b4e7-4894-9408-4708e073714c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:55.948331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:55.949229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:55.949514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:55.949785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:55.961078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:55.962632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:55.980747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:55.981873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:55.982881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:55.982881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:55.982881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:55.982881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:55.982881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 599/1228] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:55.989313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:56.091374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b885898-6bfe-4ab3-b258-80b54dad8723 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:56.128030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:56.128779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:56.129083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:56.129364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:56.130147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:56.130468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:56.131957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:56.145471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 630/1229] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:56.152444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:56.265931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060321-9631-437f-bce3-602b6da173d7 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:56.305931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:56.306977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:56.307293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:56.307562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:56.315102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:56.316631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:39:56.331295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:56.332456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:39:56.333417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 600/1230] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:56.340191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:56.448205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb96c-4eed-4439-85f0-f329d4f859f8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:56.485955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:56.486613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:56.486891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:56.487163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:56.488220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:56.488379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:56.489777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc0450-eee9-4c7e-a398-a46cfd5b1413 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:56.502610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 631/1231] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:56.509084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:56.618962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4f49-fcbf-4d27-a85c-c254ec68a3e2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:56.656687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:56.657602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:56.657879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:56.658157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/0ac72e2a7a2c40dea1cb3ebe1a2f3d93/roles/fc59e4431f5d4b6bb7d0012ee5f6f151` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:56.676558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93, role_id=fc59e4431f5d4b6bb7d0012ee5f6f151)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:56.678241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f7a6-de67-4eac-87b1-2ffaa8494382 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:56.692492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 601/1232] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:39:56 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/0ac72e2a7a2c40dea1cb3ebe1a2f3d93/roles/fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:39:59.142572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d773-da35-4db9-a7f0-eb173809f8d6 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.143153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d773-da35-4db9-a7f0-eb173809f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.143153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d773-da35-4db9-a7f0-eb173809f8d6 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.144562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 632/1233] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:39:59.150517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.151404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.151623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.169104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:39:59.170299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:39:59.239156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 602/1234] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:39:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 14:39:59.263979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2d773-da35-4db9-a7f0-eb173809f8d6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:59.371161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2d773-da35-4db9-a7f0-eb173809f8d6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:59.407375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:59.408140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.408422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.408694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.419913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:39:59.427627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:59.429284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:39:59.430143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 633/1235] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 14:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:59.435368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:59.533651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc627ad-356c-4e81-a584-52cca5eb798b None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:59.568023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:59.568701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.568979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.569209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.570010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] RBAC: Adding query filter params (name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:59.570284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:59.571697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:59.580701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 603/1236] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 14:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:39:59.586627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:59.695630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092e53-fa1f-4b86-9b61-a38c82436ca7 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:59.732015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:59.732810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.733086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.733433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.743626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:59.745112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:39:59.763516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:39:59.764697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:39:59.765937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:39:59.765937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:39:59.765937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:39:59.765937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:39:59.765937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 634/1237] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:39:59.771233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:39:59.895296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba057-a0f4-481e-a1a4-39e3a6227866 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:39:59.931151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:39:59.931849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:39:59.932120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:39:59.932383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:39:59.933227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:39:59.933525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:39:59.934939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:39:59.947543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 604/1238] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:39:59.953491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:00.069796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52cd5-a166-45a3-bd1d-5e6cec856fe1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:00.107117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:00.108076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:00.108389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:00.108707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:00.117708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:00.119478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:40:00.133844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:00.134990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:00.136247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 635/1239] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:39:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:00.143850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:00.248035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9720d-e4bb-4e39-b2bc-b015049be9b4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:00.282071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:00.282745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:00.283023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:00.283290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:00.284160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:00.284462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:00.286541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:00.307288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 605/1240] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:40:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:00.313672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:00.428533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8127c-ef50-49d4-b9e3-5a1d60ad1ef6 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:00.468337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:00.469105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:00.469429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:00.469740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:00.555716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:00.557135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:00.674172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 636/1241] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:40:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:40:00.680919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:00.790766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282269-1d9a-4e3d-976a-4a97c90f03bc None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:00.833431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:00.834675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:00.835172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:00.835755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:00.849787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:00.851656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:00.874871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:00.876613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:00.878611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:00.878611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:00.878611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:00.878611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:00.878611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 606/1242] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:00.885409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:01.004173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e1-bbcf-4c55-824b-a1f69366529e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:01.042859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:01.043837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:01.044116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:01.044384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:01.045253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:01.045563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:01.047212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:01.061375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 637/1243] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:40:01.068246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:01.177857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a593b67-62c3-45bc-a579-1507f6299c2e None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:01.219005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:01.219843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:01.220125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:01.220401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:01.228733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:01.230461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:40:01.247548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:01.249268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:01.250450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 607/1244] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:01.255539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:01.367223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e4cc-b4e3-41ae-ae80-86266eeea8ef None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:01.409124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:01.409869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:01.410146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:01.410414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:01.411204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:01.411527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:01.413047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95493da6-fc07-4347-baee-3a4e4c99093c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:01.426809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 638/1245] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:01.433332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:01.541744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca458-4169-4b43-ac67-6265d5b61b75 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:01.582608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:01.583318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:01.583604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:01.583912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:01.584759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] RBAC: Adding query filter params (role.id=fc59e4431f5d4b6bb7d0012ee5f6f151, scope.project.id=b3accb6964814c09a848544b57230884, user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:01.585071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:01.586589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd088a-cce6-49f3-835c-5f2ac320b5bf None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:01.594961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 608/1246] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:40:01 2022] GET /identity/v3/role_assignments?user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93&scope.project.id=b3accb6964814c09a848544b57230884&role.id=fc59e4431f5d4b6bb7d0012ee5f6f151 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:03.981404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35cc0-867b-4a2e-8463-7160445184f9 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:03.981973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35cc0-867b-4a2e-8463-7160445184f9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:03.981973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35cc0-867b-4a2e-8463-7160445184f9 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:03.983335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 639/1247] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:03.989054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:03.989560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:03.989652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:04.007876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:04.009057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:04.082857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 609/1248] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:04.108141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35cc0-867b-4a2e-8463-7160445184f9 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:04.222023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35cc0-867b-4a2e-8463-7160445184f9 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:04.264289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:04.264986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:04.265286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:04.265696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:04.277768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:40:04.287042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:04.288361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:04.289288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 640/1249] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:04.295928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:04.406614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b11c9a-fb1f-4173-acf3-b5d4476f63e9 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:04.443477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:04.444189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:04.444493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:04.444795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:04.445638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:04.446015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:04.447526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:04.457458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 610/1250] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:04.463577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:04.579841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087999c-e4f5-4c86-a256-d960c9c17d63 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:04.618062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:04.618970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:04.619392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:04.619610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:04.631769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:04.633461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:04.653143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:04.654377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:04.655730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:04.655730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:04.655730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:04.655730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:04.655730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 641/1251] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:04.661081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:04.774370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148062e6-556f-4e0b-9416-486102c6f881 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:04.811942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:04.812216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:04.812442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:04.812752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:04.813495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:04.813880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:04.815447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:04.829551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 611/1252] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:04.835921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:04.958644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858018b3-fc44-4030-8976-9f1c0cf07476 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:05.008773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:05.009910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:05.010182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:05.010582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:05.022105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:05.023951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:40:05.044236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:05.046227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:05.048194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 642/1253] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:05.052741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:05.189190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2cb97-bc94-4357-bf1e-96da4f37ea42 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:05.230670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:05.231564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:05.231925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:05.232195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:05.233070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:05.233391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:05.234933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:05.258351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 612/1254] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:40:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:05.265966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:05.384300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e98102-0373-45f7-896f-fe57a4309c99 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:05.426724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:05.427581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:05.427997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:05.428272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:05.510292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:05.512033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:05.619380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 643/1255] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:40:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:40:05.625899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:05.740153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15c738-7e36-4f5a-9666-ff6a4045d03d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:05.781073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:05.781841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:05.782121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:05.782388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:05.792945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:05.794674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:05.812163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:05.813217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:05.814185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:05.814185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:05.814185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:05.814185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:05.814185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 613/1256] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:05.819160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:05.951287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f02e-4c46-4190-8ac0-f68dd0d256f1 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:05.990803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:05.991826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:05.992186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:05.992814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:05.994287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:05.994912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:05.997768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:06.016210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 644/1257] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:06.024924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:06.144050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28160732-1567-4733-a4c8-0877aad4e434 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:06.182835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:06.183760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:06.184039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:06.184310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:06.191415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:06.193093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:40:06.207650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:06.209231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:06.210814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 614/1258] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:06.215622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:06.331990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a82e-9bd0-48aa-8ad4-ab567e9e5190 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:06.369590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:06.371101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:06.371384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:06.371650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:06.372467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:06.372770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:06.374266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ac7c-f8a8-4ab6-955b-2e10873ff4e3 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:06.394483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 645/1259] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:06.395963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:06.504202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303e248-24a0-401a-9610-2b5f91a4b2d2 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:06.544499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:06.545151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:06.545441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:06.545710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:06.546540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:06.546846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:06.548360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573fc2-1231-4a24-9c58-acff036228a3 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:06.554617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 615/1260] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:40:06 2022] GET /identity/v3/role_assignments?user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:08.784153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cb9b-29b4-4e4c-b8ff-f342062b0163 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:08.784708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cb9b-29b4-4e4c-b8ff-f342062b0163 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:08.784708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cb9b-29b4-4e4c-b8ff-f342062b0163 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:08.786078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 646/1261] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:08.791402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:08.791872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:08.791961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:08.809056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:08.810232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:08.885529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 616/1262] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:08.908363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268cb9b-29b4-4e4c-b8ff-f342062b0163 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.011780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268cb9b-29b4-4e4c-b8ff-f342062b0163 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.046021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.046716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.046994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.047257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.057655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:40:09.065189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:09.066258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:09.067308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 647/1263] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:09.074703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.175684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14131-4a4a-45d2-a928-2f253868f355 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.220354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.221021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.221296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.221558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.222295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:09.222591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:09.224003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:09.232581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 617/1264] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:09.238730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.344998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de1af-c734-43ac-85ae-98a30fee7871 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.378613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.379405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.379705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.379980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.390416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:09.391903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:09.408861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:09.409904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:09.411188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:09.411188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:09.411188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:09.411188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:09.411188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 648/1265] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:09.416101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.522617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d496eb-4536-4cc1-a736-ae4f33925c2c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.556886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.557647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.557923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.558186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.558935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:09.559242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:09.560726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:09.572955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 618/1266] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:09.579246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.680311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad695-3b43-49ab-9fe7-06e58f4ce45a None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.714525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.715402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.715707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.715984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.723995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:09.725448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:40:09.739609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:09.740746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:09.741835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 649/1267] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:09.747162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:09.857791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c93f-54e9-4fca-9849-fb47d34cfb89 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:09.895255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:09.895952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:09.896231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:09.896501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:09.897339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:09.897643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:09.899110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:09.916696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 619/1268] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:09.922718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:10.022388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ef373-bec8-44f8-a2e4-c7bfc2aa7ba8 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:10.056568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:10.057418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:10.057700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:10.057970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:10.068276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:10.069722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:10.086417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:10.087442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:10.088413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:10.088413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:10.088413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:10.088413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:10.088413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 650/1269] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:10.093883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:10.196124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c28c-e0d0-4a26-96e4-29450ebb534c None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:10.234149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:10.234818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:10.235096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:10.235383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:10.236131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:10.236434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:10.237837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:10.249417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 620/1270] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:10.255470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:10.356547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f888-560a-4972-9cef-f6910439ef38 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:10.390601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:10.391389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:10.391714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:10.391996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:10.399294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:10.401068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:40:10.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:10.416477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:10.417688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 651/1271] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:10.422819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:10.532438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64208b-40c5-4295-943c-faaf87f66a79 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:10.567108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:10.567821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:10.568102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:10.568383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:10.569215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:10.569532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:10.571044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3aade-2a28-4f7b-9868-5d87c9de21ac None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:10.584398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 621/1272] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:10.591294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:10.691307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b716-1612-4bd1-ab98-5f17948bfc25 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:10.723604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:10.724525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:10.724806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:10.725079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] PATH_INFO: `/v3/projects/b3accb6964814c09a848544b57230884/users/0ac72e2a7a2c40dea1cb3ebe1a2f3d93/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:10.727270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3accb6964814c09a848544b57230884, user_id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:10.728801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d35f2-22d0-43c2-a622-3f068b106021 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:10.742937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 652/1273] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 14:40:10 2022] PUT /identity/v3/projects/b3accb6964814c09a848544b57230884/users/0ac72e2a7a2c40dea1cb3ebe1a2f3d93/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:40:13.003235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8ba6-8842-495a-a1aa-e449df8b3ef9 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.003875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8ba6-8842-495a-a1aa-e449df8b3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.003875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8ba6-8842-495a-a1aa-e449df8b3ef9 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.005193 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 622/1274] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:13.010512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.010970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.011064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.029347 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:13.030692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:13.099846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 653/1275] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:13.128815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8ba6-8842-495a-a1aa-e449df8b3ef9 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:13.240878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8ba6-8842-495a-a1aa-e449df8b3ef9 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:13.277285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:13.277987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.278270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.278542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.290344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 14:40:13.297904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:13.299064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:13.300219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 623/1276] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:13.306059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:13.408679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d89c7-e83a-48ef-976b-0ca186423f68 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:13.443430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:13.444116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.444393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.444690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.445480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:13.445766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:13.447192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:13.456273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 654/1277] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:13.462341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:13.563799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee47ae-d605-4595-a7cd-7e05cb97a506 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:13.597380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:13.598177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.598456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.598723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.609731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:13.611211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:13.627888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:13.628958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:13.629895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:13.629895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:13.629895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:13.629895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:13.629895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 624/1278] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:13.635103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:13.749921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95510fa-3ae8-42bf-bd39-8cc52a8c7018 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:13.788643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:13.789316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.789680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.790046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.790767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:13.791070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:13.792533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:13.804710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 655/1279] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:13.811045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:13.930622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee93a-9a54-4944-958b-d4bbc0f30658 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:13.964291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:13.965094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:13.965365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:13.965629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:13.973327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:13.974793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 14:40:13.988915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:13.990080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:13.991243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 625/1280] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:13.998379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:14.124287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d73a-9d4f-4549-8ca9-421770f68c74 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:14.160508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:14.161176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:14.161453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:14.161724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:14.162560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:14.162871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:14.164352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:14.181384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 656/1281] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 14:40:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:14.187460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:14.287291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce1e2-ef2c-4227-80ac-2eead0c94ed4 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:14.326423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:14.327084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:14.327364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:14.327651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:14.431821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:14.434252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:14.543531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 626/1282] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 14:40:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 14:40:14.549730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:14.658089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade05a-20ac-432e-abff-0520f7581df5 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:14.692644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:14.693348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:14.693623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:14.693862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:14.704075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:14.705546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 14:40:14.724816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:14.725958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:14.726978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 14:40:14.726978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 14:40:14.726978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 14:40:14.726978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:14.726978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 657/1283] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:14.732056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:14.829703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013d80-33c9-42e9-b33e-a2b9aa2c0857 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:14.863053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:14.863701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:14.863989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:14.864261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:14.864966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:14.865257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:14.866649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:14.877833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 627/1284] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 14:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:14.883911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:14.985265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00afc2-37e9-4ec1-8c22-36d7f2505736 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:15.018692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:15.019477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:15.019779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:15.020035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:15.027297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:15.028727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 14:40:15.042394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application with Lock( May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:15.043438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: ERROR keystone.server.flask.application May 04 14:40:15.044741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 658/1285] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 14:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:15.049636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:15.151342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0e78-5a63-4923-8827-a0a42cc3577b None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:15.187029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:15.188132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:15.188742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:15.189017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:15.190010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:15.190313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:15.192332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f23056-dce4-4339-be8c-a07ae12fd487 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:15.204804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 628/1286] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 14:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:15.211187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:15.313177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db0a5-8225-4862-9562-4f6faa6b9c33 None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:15.349727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:15.350386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:15.350662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:15.350926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:15.351784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] RBAC: Adding query filter params (role.id=cb8cb673d5d74b15a4528bf0f52ecaae, scope.project.id=b3accb6964814c09a848544b57230884, user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:15.352088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:15.353511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64906a-272a-46d7-a31c-d6fd58d4409e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:15.359421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 659/1287] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 14:40:15 2022] GET /identity/v3/role_assignments?user.id=0ac72e2a7a2c40dea1cb3ebe1a2f3d93&scope.project.id=b3accb6964814c09a848544b57230884&role.id=cb8cb673d5d74b15a4528bf0f52ecaae => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:17.617229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69d59-6850-4472-89c4-636ae7374a4d None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:17.617785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69d59-6850-4472-89c4-636ae7374a4d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:17.617785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69d59-6850-4472-89c4-636ae7374a4d None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:17.619020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 629/1288] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:17.626526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:17.627052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:17.627152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:17.645728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:17.646938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:17.717491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 660/1289] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:17.740157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69d59-6850-4472-89c4-636ae7374a4d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:17.846462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69d59-6850-4472-89c4-636ae7374a4d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:17.885046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:17.885838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:17.886163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:17.886565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:17.887340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:17.889098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:17.903756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:17.905367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:17.906374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 630/1290] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:40:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:17.912111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:18.011404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218edbac-db15-46d9-9db9-16e53adebcb7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:18.049550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:18.050219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:18.050497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:18.050751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:18.051459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:18.051803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:18.053189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81167-9ea9-4983-95dd-2219b1e00911 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:18.058162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 661/1291] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 14:40:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:18.064301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:18.167292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583753d-addc-4d43-9575-66ecc46d9e99 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:18.200943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:18.201599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:18.201872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:18.202143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] PATH_INFO: `/v3/services` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:18.202846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:18.203146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:18.204574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9699f3-29bb-42dc-9597-eb5543d1f189 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:18.209106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 631/1292] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 14:40:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:20.432088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c97a2-8922-4bfb-8b48-fc1cf0762d8c None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:20.432686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c97a2-8922-4bfb-8b48-fc1cf0762d8c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:20.432686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c97a2-8922-4bfb-8b48-fc1cf0762d8c None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:20.434012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 662/1293] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:20.439335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0e13-792c-4407-b4ea-74d36b5a09f2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:20.439796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0e13-792c-4407-b4ea-74d36b5a09f2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:20.439885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0e13-792c-4407-b4ea-74d36b5a09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:20.457603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-590c0e13-792c-4407-b4ea-74d36b5a09f2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:20.458821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-590c0e13-792c-4407-b4ea-74d36b5a09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:20.531350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 632/1294] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:20.555428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c97a2-8922-4bfb-8b48-fc1cf0762d8c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:20.662529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c97a2-8922-4bfb-8b48-fc1cf0762d8c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:20.697195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:20.697857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:20.698134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:20.698405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:20.699132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:20.700530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0e899-1202-4e9a-848a-4c122f6f060c None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:20.715131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 663/1295] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 14:40:20 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:40:22.970576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b708a-cfd5-43b8-9176-ba97c0fb5055 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:22.971170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b708a-cfd5-43b8-9176-ba97c0fb5055 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:22.971170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b708a-cfd5-43b8-9176-ba97c0fb5055 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:22.972510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 633/1296] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:22.977923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:22.978333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:22.978476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:22.996474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:22.997681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:23.079951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 664/1297] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:23.102995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b708a-cfd5-43b8-9176-ba97c0fb5055 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:23.208958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b708a-cfd5-43b8-9176-ba97c0fb5055 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:23.244063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:23.244829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:23.245100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:23.245361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] PATH_INFO: `/v3/services/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:23.246006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:23.247409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:23.259324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:23.260578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:23.261649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 634/1298] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:40:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 14:40:23.267031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:23.368783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468810-f86a-4920-9735-2fa85598eed3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:23.403118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:23.403810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:23.404087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:23.404354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:23.405064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:23.405371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:23.406754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:23.412039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 665/1299] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 14:40:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:23.419072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:23.552452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1339a-6d05-4231-9001-c62f917a060d None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:23.585783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:23.586432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:23.586706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:23.586968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:23.587782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] RBAC: Adding query filter params (interface=public, service_id=7727e9fb19c34effbe682b955e63d36d, region_id=RegionOne) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:23.588085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:23.589515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21e36-f8cf-406a-83c1-90c7fdb704a4 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:23.594652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 635/1300] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 14:40:23 2022] GET /identity/v3/endpoints?service_id=7727e9fb19c34effbe682b955e63d36d&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:23.603705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:23.747687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888db4a-af4b-45ba-9633-9467e088029e None admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:23.782706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:23.783400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:23.783706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:23.783977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:23.784733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:23.786124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064c02-a0c7-487a-bf27-0738d40f86d9 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:23.793161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 666/1301] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 14:40:23 2022] GET /identity/v3/services => generated 2191 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:40:26.056485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067ef2-cc36-42e5-9bcc-214e7cc3f243 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:26.057123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067ef2-cc36-42e5-9bcc-214e7cc3f243 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:26.057245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067ef2-cc36-42e5-9bcc-214e7cc3f243 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:26.058572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 636/1302] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:40:26.063825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:26.064296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:26.064389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:26.082334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:40:26.083540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:40:26.157793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 667/1303] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:40:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 14:40:26.180705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067ef2-cc36-42e5-9bcc-214e7cc3f243 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:26.282933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067ef2-cc36-42e5-9bcc-214e7cc3f243 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:26.318688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:26.319400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:26.319715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:26.319975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:26.320633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:26.322092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 14:40:26.334701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 14:40:26.336805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.get_or_create( May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application with Lock( May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self._enter() May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application return self.creator() May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application created_value = creator( May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: ERROR keystone.server.flask.application May 04 14:40:26.339029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 637/1304] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 14:40:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 14:40:26.344818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:26.449882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f4c7-888f-433f-bef5-aed35df971ea None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:26.481989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:26.482652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:26.482931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:26.483206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] PATH_INFO: `/v3/services` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:26.483946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:40:26.484249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:26.485652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239b2d-9dcd-4bd1-ab88-73fcf7e2ea11 None admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:26.491083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 668/1305] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 14:40:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:40:26.497493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:40:26.605797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0de3-d6ef-413e-9aef-eb5d8daa3707 None admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:40:26.640637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:40:26.641302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:40:26.641580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:40:26.641849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:40:26.642599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:40:26.644065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017af6c7-7aef-4b25-9fc7-db475f02f569 None admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:40:26.664412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 638/1306] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 14:40:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:41:31.769926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f58b5-dfa0-4c8e-9ba1-d4b8ebcbd9b3 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:31.770536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f58b5-dfa0-4c8e-9ba1-d4b8ebcbd9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:31.770536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f58b5-dfa0-4c8e-9ba1-d4b8ebcbd9b3 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:31.772454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 669/1307] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:31.779517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1667-d52b-4841-8861-27b62f7271d5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:31.780122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1667-d52b-4841-8861-27b62f7271d5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:31.780122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1667-d52b-4841-8861-27b62f7271d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:31.877091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-200a1667-d52b-4841-8861-27b62f7271d5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:31.878345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-200a1667-d52b-4841-8861-27b62f7271d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:32.026284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 639/1308] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:32.082636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:32.082977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:32.083351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:32.086719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 670/1309] 10.222.0.21 () {54 vars in 964 bytes} [Wed May 4 14:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:32.095058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f943-01f9-4d86-8da3-14f42ecc5cde None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:32.095659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f943-01f9-4d86-8da3-14f42ecc5cde None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:32.096162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f943-01f9-4d86-8da3-14f42ecc5cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:32.181229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-df20f943-01f9-4d86-8da3-14f42ecc5cde None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:32.182432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-df20f943-01f9-4d86-8da3-14f42ecc5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:32.276514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 640/1310] 10.222.0.21 () {58 vars in 1061 bytes} [Wed May 4 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:41:32.285525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:32.287286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:32.422537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248bac-a4f4-4ac1-ab4f-6731dfcb18bc None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:32.513656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:32.514379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:32.514667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:32.514910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:32.516757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:32.647853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:32.649363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e324a-3534-4e86-b5cc-6aabb14b5e24 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:32.673836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 671/1311] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:35.242061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fdd1e-04ae-4be0-bde4-b93874596231 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:35.242656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fdd1e-04ae-4be0-bde4-b93874596231 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:35.242656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fdd1e-04ae-4be0-bde4-b93874596231 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:35.244089 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 641/1312] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:35.249674 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5d28-272d-4385-b82d-11396715e5be None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:35.250182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5d28-272d-4385-b82d-11396715e5be None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:35.250182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5d28-272d-4385-b82d-11396715e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:35.326245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-710e5d28-272d-4385-b82d-11396715e5be None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:35.327480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-710e5d28-272d-4385-b82d-11396715e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:35.434121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 672/1313] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:35.488087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:35.488320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:35.488623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:35.489987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 642/1314] 10.222.0.21 () {54 vars in 964 bytes} [Wed May 4 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:35.496904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e49b9-e357-4c65-b172-e6d06c8d0345 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:35.497439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e49b9-e357-4c65-b172-e6d06c8d0345 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:35.497711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e49b9-e357-4c65-b172-e6d06c8d0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:35.574194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c45e49b9-e357-4c65-b172-e6d06c8d0345 None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:35.575444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c45e49b9-e357-4c65-b172-e6d06c8d0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:35.653168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 673/1315] 10.222.0.21 () {58 vars in 1061 bytes} [Wed May 4 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:41:35.663158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:35.664821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:35.787953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba753dc-6713-4f50-953c-a09a6f972124 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:35.865614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:35.866493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:35.866860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:35.867294 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:35.869375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:35.997012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:35.998469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd494-b0a1-4b90-955b-24a1a130672a service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:36.042925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 643/1316] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:38.845375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:38.845976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:38.845976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:38.847327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 674/1317] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:38.853066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f71b-8f09-493b-aed4-573b53e235b9 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:38.853559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f71b-8f09-493b-aed4-573b53e235b9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:38.853647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f71b-8f09-493b-aed4-573b53e235b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:38.923862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-98a6f71b-8f09-493b-aed4-573b53e235b9 None None] MFA Rules not processed for user `3bd206864bcc414c9408f8a1f6b0e30e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:38.925074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-98a6f71b-8f09-493b-aed4-573b53e235b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:39.028787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 644/1318] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:39.067777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:39.069352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:39.182460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ac3ec-c7d4-471f-baf7-aa8ff1380d60 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:39.258395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:39.259057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:39.259308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:39.259609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:39.261349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:39.383298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:39.384821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d534d-6d29-4749-a207-fc322479b5fc service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:39.405118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 675/1319] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:42.328257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea33-d554-4731-870c-51663e52efef None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:42.329098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea33-d554-4731-870c-51663e52efef None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:42.329258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea33-d554-4731-870c-51663e52efef None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:42.330859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 645/1320] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:42.337582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16886a2-5356-48ea-ac4c-75d2314cf189 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:42.338495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16886a2-5356-48ea-ac4c-75d2314cf189 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:42.338495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16886a2-5356-48ea-ac4c-75d2314cf189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:42.422120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e16886a2-5356-48ea-ac4c-75d2314cf189 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:42.423375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e16886a2-5356-48ea-ac4c-75d2314cf189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:42.551985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 676/1321] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:42.597038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ea33-d554-4731-870c-51663e52efef None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:42.598818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a072ea33-d554-4731-870c-51663e52efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:42.739695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ea33-d554-4731-870c-51663e52efef None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:42.845007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:42.845822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:42.846140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:42.846449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:42.848609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:42.971954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:42.973526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405b59d-a1fe-464c-b6c9-9cf90f7c58ab service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:42.992857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 646/1322] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:46.708431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:46.709104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:46.709360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:46.711967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 677/1323] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:46.720764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d98dd-29e5-4e63-a14f-85962e39e432 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:46.721346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d98dd-29e5-4e63-a14f-85962e39e432 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:46.721669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d98dd-29e5-4e63-a14f-85962e39e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:46.816390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-bb1d98dd-29e5-4e63-a14f-85962e39e432 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:46.817710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-bb1d98dd-29e5-4e63-a14f-85962e39e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:46.932145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 647/1324] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:46.973687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:46.975432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:47.105559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3497b4-0339-4036-b6ab-2dd08f83dffe None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:47.194749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:47.195474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:47.195789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:47.196060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:47.197881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:47.323995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:47.325461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fb700-3fde-434b-a135-0d15cfe6ad17 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:47.347996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 678/1325] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:49.902574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:49.903210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:49.903210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:49.905113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 648/1326] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:41:49.914165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe416-a8c0-4e5c-9221-d9c4126bbb41 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:49.914917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe416-a8c0-4e5c-9221-d9c4126bbb41 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:49.915125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe416-a8c0-4e5c-9221-d9c4126bbb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:50.010611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c5cbe416-a8c0-4e5c-9221-d9c4126bbb41 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:50.011878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c5cbe416-a8c0-4e5c-9221-d9c4126bbb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:50.130378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 679/1327] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:50.175022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:50.177394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:50.335393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f928a1-063d-4c9f-8fa2-7e49ff5778c4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:50.433662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:50.434264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:50.434539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:50.434806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:50.436521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:50.581811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:50.583749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba19a8f-b057-4ce7-9cf0-9a01df2ffc30 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:50.606204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 649/1328] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:41:53.187236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:53.187961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:53.187961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:53.189348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 680/1329] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:53.197293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09532-ed48-4d24-818e-c648abc54145 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:53.201242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09532-ed48-4d24-818e-c648abc54145 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:53.201690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09532-ed48-4d24-818e-c648abc54145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:53.285396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8bb09532-ed48-4d24-818e-c648abc54145 None None] MFA Rules not processed for user `3bd206864bcc414c9408f8a1f6b0e30e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:53.286657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8bb09532-ed48-4d24-818e-c648abc54145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:53.404346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 650/1330] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:53.442425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:53.444225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:53.561732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06a81c-1bf9-429d-b47b-bb1e440a1270 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:53.643007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:53.643737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:53.644044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:53.644321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:53.646193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:53.788565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:53.789951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf05300-db65-463e-a85f-521096a2ef62 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:53.809974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 681/1331] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:56.600825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:56.601830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:56.602326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:56.605395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 651/1332] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:41:56.614375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dae26-e054-454f-acb4-eb0c40a34548 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:56.614934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dae26-e054-454f-acb4-eb0c40a34548 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:56.614934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dae26-e054-454f-acb4-eb0c40a34548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:56.721219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ca8dae26-e054-454f-acb4-eb0c40a34548 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:56.722789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ca8dae26-e054-454f-acb4-eb0c40a34548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:56.849202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 682/1333] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:41:56.886472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:56.888284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:57.022144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4157a1-ffe6-4028-9af0-01785992c4d3 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:41:57.108858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:41:57.109540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:57.109817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:57.110089 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:57.111790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:57.245303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:41:57.246877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac28dc-f65a-4d41-95eb-bf3c0282f9fb service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:41:57.269000 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 652/1334] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:41:59.681722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85969a8-e44b-419c-a618-19116447a389 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:59.682312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85969a8-e44b-419c-a618-19116447a389 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:59.682312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85969a8-e44b-419c-a618-19116447a389 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:59.683690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 683/1335] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:41:59.689505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd62ff-dcec-4182-a13b-8f60c1f5b2b5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:41:59.690067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd62ff-dcec-4182-a13b-8f60c1f5b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:41:59.690298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd62ff-dcec-4182-a13b-8f60c1f5b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:41:59.764382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-78dd62ff-dcec-4182-a13b-8f60c1f5b2b5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:41:59.765498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-78dd62ff-dcec-4182-a13b-8f60c1f5b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:41:59.879309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 653/1336] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:41:59.920398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85969a8-e44b-419c-a618-19116447a389 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:41:59.922057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c85969a8-e44b-419c-a618-19116447a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:00.045006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85969a8-e44b-419c-a618-19116447a389 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:00.147340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:00.148082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:00.148376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:00.148650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:00.150844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:00.291413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:00.292941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce961c0-eb22-4df4-8848-5ed44090395b service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:00.320059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 684/1337] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:03.118454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:03.119040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:03.119140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:03.120765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 654/1338] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:03.126705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b45ba-4ca0-4f5a-bb71-0d00ee66e98d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:03.127358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b45ba-4ca0-4f5a-bb71-0d00ee66e98d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:03.127358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b45ba-4ca0-4f5a-bb71-0d00ee66e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:03.204190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-262b45ba-4ca0-4f5a-bb71-0d00ee66e98d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:03.205409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-262b45ba-4ca0-4f5a-bb71-0d00ee66e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:03.321547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 685/1339] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:03.357144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:03.359472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:03.459786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3c5dd-6be8-4d65-86c9-03e1c1e7734b None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:03.464152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:03.464813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:03.465179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:03.465455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:03.476436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:03.477927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607140-5ad6-478c-96a2-a379d652c465 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:03.488712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 655/1340] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:08.131740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:08.132339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:08.132339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:08.133778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 686/1341] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:08.139114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1a25-b17c-4a21-b300-677699b74f5a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:08.139578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1a25-b17c-4a21-b300-677699b74f5a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:08.139714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1a25-b17c-4a21-b300-677699b74f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:08.169118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dffa1a25-b17c-4a21-b300-677699b74f5a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:08.170309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dffa1a25-b17c-4a21-b300-677699b74f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:08.247749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 656/1342] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:08.286376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:08.288378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:08.303720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dc9c6-2c90-49c3-9346-0e597fc882a9 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:08.307871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:08.308517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:08.308794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:08.309062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:08.319077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:08.320682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57df159-07f5-45c8-938c-2f070eb7055a service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:08.331339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 687/1343] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:11.362209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd223-5863-40a7-b0c2-8a101c70614a None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:11.362763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd223-5863-40a7-b0c2-8a101c70614a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:11.362763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd223-5863-40a7-b0c2-8a101c70614a None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:11.364172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 657/1344] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:11.370007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2891b4-f9d4-4c10-bb01-5806d0569b1c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:11.370546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2891b4-f9d4-4c10-bb01-5806d0569b1c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:11.370546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2891b4-f9d4-4c10-bb01-5806d0569b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:11.388759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4e2891b4-f9d4-4c10-bb01-5806d0569b1c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:11.389940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4e2891b4-f9d4-4c10-bb01-5806d0569b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:11.398799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 688/1345] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:11.436855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd223-5863-40a7-b0c2-8a101c70614a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:11.450312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd223-5863-40a7-b0c2-8a101c70614a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:11.454295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:11.454942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:11.455249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:11.455495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:11.465487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:11.467370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070178-d7ec-48aa-9a5c-3b2a676b6f16 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:11.477411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 658/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:15.882647 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330d722-d7c2-426d-97c7-f6944ee609da None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:15.883176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330d722-d7c2-426d-97c7-f6944ee609da None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:15.883176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330d722-d7c2-426d-97c7-f6944ee609da None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:15.884626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 689/1347] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:15.890249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121a0-c55c-455b-b5f0-2c8db61231f5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:15.890932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121a0-c55c-455b-b5f0-2c8db61231f5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:15.890932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6121a0-c55c-455b-b5f0-2c8db61231f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:15.920119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-fa6121a0-c55c-455b-b5f0-2c8db61231f5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:15.921424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fa6121a0-c55c-455b-b5f0-2c8db61231f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:15.931598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 659/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:15.969371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330d722-d7c2-426d-97c7-f6944ee609da None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:15.982024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330d722-d7c2-426d-97c7-f6944ee609da None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:15.986253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:15.986897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:15.987179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:15.987452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:16.001843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:16.003336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0282a-e8cb-4536-8c69-542b8e52fd78 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:16.013371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 690/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:21.667450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26dcb-55da-440c-a40e-b52e32738124 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:21.668728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26dcb-55da-440c-a40e-b52e32738124 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:21.669274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26dcb-55da-440c-a40e-b52e32738124 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:21.671188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 660/1350] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:42:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:21.678815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c6b08-0ce3-4c6c-a47c-dcf42c135d91 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:21.679973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c6b08-0ce3-4c6c-a47c-dcf42c135d91 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:21.680461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c6b08-0ce3-4c6c-a47c-dcf42c135d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:21.810365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fe3c6b08-0ce3-4c6c-a47c-dcf42c135d91 None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:21.812049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fe3c6b08-0ce3-4c6c-a47c-dcf42c135d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:21.927320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 691/1351] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:25.975646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063645-4033-4702-a840-520f302815fc None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:25.976856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063645-4033-4702-a840-520f302815fc None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:25.977233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063645-4033-4702-a840-520f302815fc None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:25.978686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 661/1352] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:25.984589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37479b32-11e1-4931-83f9-347caa33cde3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:25.985060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37479b32-11e1-4931-83f9-347caa33cde3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:25.985304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37479b32-11e1-4931-83f9-347caa33cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:26.006304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-37479b32-11e1-4931-83f9-347caa33cde3 None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:26.007648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-37479b32-11e1-4931-83f9-347caa33cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:26.018327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 692/1353] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:27.476303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bbf07-5b5a-445e-a20b-e894b5374f90 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:27.476904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bbf07-5b5a-445e-a20b-e894b5374f90 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:27.476904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bbf07-5b5a-445e-a20b-e894b5374f90 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:27.478180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 662/1354] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:27.483236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38680-70a1-4ba0-800c-65da2c82cfce None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:27.483706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38680-70a1-4ba0-800c-65da2c82cfce None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:27.483818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38680-70a1-4ba0-800c-65da2c82cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:27.502726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d4b38680-70a1-4ba0-800c-65da2c82cfce None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:27.503999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d4b38680-70a1-4ba0-800c-65da2c82cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:27.513182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 693/1355] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:31.582912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa48e-a57f-468b-96eb-fb36b8c3f0ca None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:31.583656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa48e-a57f-468b-96eb-fb36b8c3f0ca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:31.583656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa48e-a57f-468b-96eb-fb36b8c3f0ca None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:31.584813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 663/1356] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:31.591468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8cce-e8ad-4c89-9faf-d2824f8b90be None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:31.592097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8cce-e8ad-4c89-9faf-d2824f8b90be None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:31.592719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8cce-e8ad-4c89-9faf-d2824f8b90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:31.620476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7dff8cce-e8ad-4c89-9faf-d2824f8b90be None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:31.622455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7dff8cce-e8ad-4c89-9faf-d2824f8b90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:31.656001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 694/1357] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:31.707847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e724-7540-4741-944d-ac01363c9928 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:31.708154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e724-7540-4741-944d-ac01363c9928 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:31.708385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e724-7540-4741-944d-ac01363c9928 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:31.709921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 664/1358] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:42:31.716456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227593-ab2f-4e0b-8962-0ed6637b39a8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:31.717546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227593-ab2f-4e0b-8962-0ed6637b39a8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:31.718388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227593-ab2f-4e0b-8962-0ed6637b39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:31.780010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ae227593-ab2f-4e0b-8962-0ed6637b39a8 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:31.781397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ae227593-ab2f-4e0b-8962-0ed6637b39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:31.900252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 695/1359] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:31.908714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e724-7540-4741-944d-ac01363c9928 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:31.923411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e724-7540-4741-944d-ac01363c9928 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:31.929133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:31.929775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:31.930044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:31.930501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:31.940990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:31.942697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e4cb6-d19d-4f7c-afb4-18daeacff7d4 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:31.955603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 665/1360] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:34.599262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f460c-7d5f-4336-8091-bac00fc0fd9a None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:34.599939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f460c-7d5f-4336-8091-bac00fc0fd9a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:34.599939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f460c-7d5f-4336-8091-bac00fc0fd9a None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:34.613927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 696/1361] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:34 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:34.616421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435526-c7e3-4525-8ba6-b7e03fb550e8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:34.617046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435526-c7e3-4525-8ba6-b7e03fb550e8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:34.617463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435526-c7e3-4525-8ba6-b7e03fb550e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:34.649412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f9435526-c7e3-4525-8ba6-b7e03fb550e8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:34.652138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f9435526-c7e3-4525-8ba6-b7e03fb550e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:34.680593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 666/1362] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:34.733838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f460c-7d5f-4336-8091-bac00fc0fd9a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:34.751221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f460c-7d5f-4336-8091-bac00fc0fd9a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:34.761414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:34.763099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:34.763770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:34.764459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:34.780829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:34.784122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601707-2c69-4908-aae6-ea3908c4b6b2 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:34.801451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 697/1363] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:42:37.858612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e0ab-99cf-4131-a48e-fe0d9aa1515b None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:37.859175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e0ab-99cf-4131-a48e-fe0d9aa1515b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:37.859175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e0ab-99cf-4131-a48e-fe0d9aa1515b None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:37.860452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 667/1364] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:37.867150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3e8a-03eb-4f0f-bf9c-da600ab7069e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:37.868391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3e8a-03eb-4f0f-bf9c-da600ab7069e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:37.868391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3e8a-03eb-4f0f-bf9c-da600ab7069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:37.890646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d5ec3e8a-03eb-4f0f-bf9c-da600ab7069e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:37.892088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d5ec3e8a-03eb-4f0f-bf9c-da600ab7069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:37.902865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 698/1365] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:37.955421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20022-f9a8-441c-8f42-d2fe21fce962 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:37.955727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20022-f9a8-441c-8f42-d2fe21fce962 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:37.956034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20022-f9a8-441c-8f42-d2fe21fce962 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:37.957512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 668/1366] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:42:37.963718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96807-849e-4078-9207-8d8802f7d6c5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:37.964155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96807-849e-4078-9207-8d8802f7d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:37.964528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96807-849e-4078-9207-8d8802f7d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:37.989374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-06d96807-849e-4078-9207-8d8802f7d6c5 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:37.990577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-06d96807-849e-4078-9207-8d8802f7d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:38.012813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 699/1367] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:38.021431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20022-f9a8-441c-8f42-d2fe21fce962 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:38.040709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20022-f9a8-441c-8f42-d2fe21fce962 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:38.049842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:38.050542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:38.050855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:38.051217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:38.060443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:38.062282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6eaea-4aeb-4f29-8b2b-b7662a65ae1f service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:38.074584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 669/1368] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:40.681815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0a49-5594-49a8-9945-a7f8c0538c10 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:40.682488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0a49-5594-49a8-9945-a7f8c0538c10 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:40.685225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0a49-5594-49a8-9945-a7f8c0538c10 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:40.687859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 700/1369] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:40.697302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332983-42d6-4fe1-aeb5-01d9a7a80420 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:40.698227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332983-42d6-4fe1-aeb5-01d9a7a80420 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:40.698227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332983-42d6-4fe1-aeb5-01d9a7a80420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:40.728878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ec332983-42d6-4fe1-aeb5-01d9a7a80420 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:40.730430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ec332983-42d6-4fe1-aeb5-01d9a7a80420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:40.747807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 670/1370] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:42:40.821512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0a49-5594-49a8-9945-a7f8c0538c10 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:40.846898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0a49-5594-49a8-9945-a7f8c0538c10 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:40.861897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:40.863456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:40.864812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:40.864989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:40.882387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:40.885404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146c9e5-2480-4f59-9c60-720776a628b3 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:40.904623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 701/1371] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:41.009754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eddedd-80e1-4a62-9e94-8e1f08d4ed3a None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:41.010152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eddedd-80e1-4a62-9e94-8e1f08d4ed3a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:41.010477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eddedd-80e1-4a62-9e94-8e1f08d4ed3a None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:41.012854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 671/1372] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:41.020811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414f00-2926-45b5-ab52-9c64e12081fb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:41.021437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414f00-2926-45b5-ab52-9c64e12081fb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:41.021827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414f00-2926-45b5-ab52-9c64e12081fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:41.049599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d4414f00-2926-45b5-ab52-9c64e12081fb None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:41.051399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d4414f00-2926-45b5-ab52-9c64e12081fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:41.069868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 702/1373] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:41.353609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce24d-a4f4-4e49-a8ae-3ade6eba1536 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:41.353894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce24d-a4f4-4e49-a8ae-3ade6eba1536 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:41.354425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce24d-a4f4-4e49-a8ae-3ade6eba1536 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:41.356407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 672/1374] 10.222.0.21 () {54 vars in 963 bytes} [Wed May 4 14:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:41.363698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a672-c523-430c-bc78-b713110582e4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:41.364109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a672-c523-430c-bc78-b713110582e4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:41.364471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a672-c523-430c-bc78-b713110582e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:41.433833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-94a5a672-c523-430c-bc78-b713110582e4 None None] MFA Rules not processed for user `5cb06fb2f9574061859dc8e25ec44bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:41.435547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-94a5a672-c523-430c-bc78-b713110582e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:41.529044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 703/1375] 10.222.0.21 () {58 vars in 1060 bytes} [Wed May 4 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:41.541513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ce24d-a4f4-4e49-a8ae-3ade6eba1536 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:41.556573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ce24d-a4f4-4e49-a8ae-3ade6eba1536 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:41.561125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:41.562369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:41.562849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:41.563402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:41.575158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:41.577162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c4e91-14ba-458a-8802-862d17821fee service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:41.590714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 673/1376] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:42:43.562360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91997-428f-47ee-a0aa-7f79bde2dfc8 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:43.562884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91997-428f-47ee-a0aa-7f79bde2dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:43.562884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91997-428f-47ee-a0aa-7f79bde2dfc8 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:43.564391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 704/1377] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:42:43.570542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab3d3-ecab-464c-b755-f0da5ac0e9c8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:43.571139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab3d3-ecab-464c-b755-f0da5ac0e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:43.571139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab3d3-ecab-464c-b755-f0da5ac0e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:43.590521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f5dab3d3-ecab-464c-b755-f0da5ac0e9c8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:43.592188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f5dab3d3-ecab-464c-b755-f0da5ac0e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:43.604068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 674/1378] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:43.651356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91997-428f-47ee-a0aa-7f79bde2dfc8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:43.664286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91997-428f-47ee-a0aa-7f79bde2dfc8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:43.673300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:43.673963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:43.674245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:43.674518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:43.683875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:43.685506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c983c5f-8947-41ab-8741-9dbec13b51c1 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:43.695954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 705/1379] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:46.027279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c6d7-7127-49af-b19d-c976367c27fe None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:46.027882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c6d7-7127-49af-b19d-c976367c27fe None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:46.028160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c6d7-7127-49af-b19d-c976367c27fe None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:46.029628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 675/1380] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:46.035070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef611ad-58f6-47a2-ad5d-b2dc0c8bf020 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:46.035528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef611ad-58f6-47a2-ad5d-b2dc0c8bf020 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:46.035628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef611ad-58f6-47a2-ad5d-b2dc0c8bf020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:46.054264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7ef611ad-58f6-47a2-ad5d-b2dc0c8bf020 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:46.055511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7ef611ad-58f6-47a2-ad5d-b2dc0c8bf020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:46.063702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 706/1381] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:46.108015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c6d7-7127-49af-b19d-c976367c27fe None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:46.123208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c6d7-7127-49af-b19d-c976367c27fe None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:46.129214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:46.130013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:46.130292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:46.130565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:46.139786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:46.141412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f096dc-00e5-4cba-b88e-50e252cae414 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:46.151716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 676/1382] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:48.507631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c115c6c-265b-481c-9384-74569b0f4875 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:48.508243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c115c6c-265b-481c-9384-74569b0f4875 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:48.508243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c115c6c-265b-481c-9384-74569b0f4875 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:48.509584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 707/1383] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:48.515064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b67e3-d5c2-4db8-9c6d-83374863ab75 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:48.515939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b67e3-d5c2-4db8-9c6d-83374863ab75 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:48.516421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b67e3-d5c2-4db8-9c6d-83374863ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:48.534613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-469b67e3-d5c2-4db8-9c6d-83374863ab75 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:48.535839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-469b67e3-d5c2-4db8-9c6d-83374863ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:48.543943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 677/1384] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:48.585410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c115c6c-265b-481c-9384-74569b0f4875 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:48.600697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c115c6c-265b-481c-9384-74569b0f4875 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:48.606281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:48.606923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:48.607199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:48.607468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:48.616479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:48.618062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee5aff-604e-4fc7-a7c3-c4d1c7c546e5 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:48.628389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 708/1385] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:50.951018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45071bd-6332-4aae-8e92-40bc4da6c7fc None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:50.951630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45071bd-6332-4aae-8e92-40bc4da6c7fc None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:50.951630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45071bd-6332-4aae-8e92-40bc4da6c7fc None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:50.953013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 678/1386] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:50.958737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2502-46cd-414d-807c-d39d132b392b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:50.959373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2502-46cd-414d-807c-d39d132b392b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:50.959373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2502-46cd-414d-807c-d39d132b392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:50.978276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7bfb2502-46cd-414d-807c-d39d132b392b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:50.979542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7bfb2502-46cd-414d-807c-d39d132b392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:50.988262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 709/1387] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:51.037040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45071bd-6332-4aae-8e92-40bc4da6c7fc None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:51.053376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45071bd-6332-4aae-8e92-40bc4da6c7fc None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:51.060568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:51.061518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:51.061895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:51.062246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:51.074774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:51.076984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c7824-bfd0-44c9-8a6f-096cd2e81f61 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:51.090457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 679/1388] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:53.777692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84134-3b74-4d9b-89fc-72757cffb8b9 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:53.778300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84134-3b74-4d9b-89fc-72757cffb8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:53.778300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84134-3b74-4d9b-89fc-72757cffb8b9 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:53.780305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 710/1389] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:53.787466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab8f8-b5e8-4788-8ceb-a86d8f4c051e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:53.787466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab8f8-b5e8-4788-8ceb-a86d8f4c051e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:53.788262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab8f8-b5e8-4788-8ceb-a86d8f4c051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:53.808724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9a7ab8f8-b5e8-4788-8ceb-a86d8f4c051e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:53.809984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9a7ab8f8-b5e8-4788-8ceb-a86d8f4c051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:53.818801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 680/1390] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:53.868989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d84134-3b74-4d9b-89fc-72757cffb8b9 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:53.884210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d84134-3b74-4d9b-89fc-72757cffb8b9 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:53.892524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:53.892937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:53.893217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:53.893486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:53.903325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:53.904978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eadf47-60db-48e1-aeae-96d8c3f9030f service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:53.915496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 711/1391] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:56.326440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2624-d4d9-4846-bb85-e070112eb697 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:56.327330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2624-d4d9-4846-bb85-e070112eb697 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:56.327330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2624-d4d9-4846-bb85-e070112eb697 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:56.328565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 681/1392] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:42:56.334922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169b373-2f90-473d-b1df-41232992e264 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:56.335912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169b373-2f90-473d-b1df-41232992e264 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:56.336248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169b373-2f90-473d-b1df-41232992e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:56.359034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5169b373-2f90-473d-b1df-41232992e264 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:56.360293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5169b373-2f90-473d-b1df-41232992e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:56.373395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 712/1393] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:42:56.425394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2624-d4d9-4846-bb85-e070112eb697 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:56.447333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2624-d4d9-4846-bb85-e070112eb697 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:56.457282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:56.457947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:56.458258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:56.458539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:56.476181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:56.479532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50654-f3d9-4476-b71a-56412a40865d service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:56.498896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 682/1394] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:57.677580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ddbb-48b6-4f6b-ba38-8472054a57d1 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:57.679924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ddbb-48b6-4f6b-ba38-8472054a57d1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:57.679924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ddbb-48b6-4f6b-ba38-8472054a57d1 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:57.679924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 713/1395] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:57.686876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe25f5-929c-49f1-87af-c5c58b82db2d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:57.687404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe25f5-929c-49f1-87af-c5c58b82db2d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:57.687715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe25f5-929c-49f1-87af-c5c58b82db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:57.709660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1ffe25f5-929c-49f1-87af-c5c58b82db2d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:57.711388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1ffe25f5-929c-49f1-87af-c5c58b82db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:57.720781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 683/1396] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:57.788125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b514-12a3-4de5-9a0b-cbbcaf37379f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:57.788612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b514-12a3-4de5-9a0b-cbbcaf37379f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:57.788775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73b514-12a3-4de5-9a0b-cbbcaf37379f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:57.790205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 714/1397] 10.222.0.21 () {54 vars in 962 bytes} [Wed May 4 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:57.799038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e87ea-d547-4b57-b553-dbcdad044d4d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:57.800074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e87ea-d547-4b57-b553-dbcdad044d4d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:57.800510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e87ea-d547-4b57-b553-dbcdad044d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:57.861882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0e2e87ea-d547-4b57-b553-dbcdad044d4d None None] MFA Rules not processed for user `3408c447488e472399394fdd26215a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:57.863603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0e2e87ea-d547-4b57-b553-dbcdad044d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:57.939176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 684/1398] 10.222.0.21 () {58 vars in 1059 bytes} [Wed May 4 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:57.947955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73b514-12a3-4de5-9a0b-cbbcaf37379f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:57.959644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73b514-12a3-4de5-9a0b-cbbcaf37379f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:57.963758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:57.964452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:57.964729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:57.964993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:57.975098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:57.976856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1db0b7-882a-4416-9f50-7a4e5f6c5d81 service glance] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:57.996412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 715/1399] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:42:58.461160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c3f-24a5-421c-b71c-36d0d6ebe039 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.461406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c3f-24a5-421c-b71c-36d0d6ebe039 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.461700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c3f-24a5-421c-b71c-36d0d6ebe039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.511150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-206d5c3f-24a5-421c-b71c-36d0d6ebe039 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:58.512391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-206d5c3f-24a5-421c-b71c-36d0d6ebe039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:58.576976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 685/1400] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:58.623176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75d5e-e03e-494e-8fb7-c9d764a92e0f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.623543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75d5e-e03e-494e-8fb7-c9d764a92e0f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.623924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75d5e-e03e-494e-8fb7-c9d764a92e0f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.625428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 716/1401] 10.222.0.21 () {54 vars in 942 bytes} [Wed May 4 14:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:58.632512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacdde-4f01-45f4-a975-a947efd6f9d5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.632874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacdde-4f01-45f4-a975-a947efd6f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.633210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacdde-4f01-45f4-a975-a947efd6f9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.701308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9ceacdde-4f01-45f4-a975-a947efd6f9d5 None None] MFA Rules not processed for user `66ba10ffb7804f6e9a05ae87d2c249c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:58.702577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9ceacdde-4f01-45f4-a975-a947efd6f9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:58.781482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 686/1402] 10.222.0.21 () {58 vars in 1039 bytes} [Wed May 4 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:58.790885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc75d5e-e03e-494e-8fb7-c9d764a92e0f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:58.805290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc75d5e-e03e-494e-8fb7-c9d764a92e0f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:58.810535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:58.811292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.811636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.812004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.821079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:58.822778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925f2e-8eab-481d-863c-4c10070db249 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:58.831680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 717/1403] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:42:58.854410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3840a-0782-46f1-99b1-1ba4a2dda7e1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.854690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3840a-0782-46f1-99b1-1ba4a2dda7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.855013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3840a-0782-46f1-99b1-1ba4a2dda7e1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.856621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 687/1404] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:42:58.862579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348e2c-6fe8-4dcb-9012-149323463eb0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.862868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348e2c-6fe8-4dcb-9012-149323463eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.863150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348e2c-6fe8-4dcb-9012-149323463eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.884973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-32348e2c-6fe8-4dcb-9012-149323463eb0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:42:58.886199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-32348e2c-6fe8-4dcb-9012-149323463eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:42:58.894518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 718/1405] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:42:58.950506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3840a-0782-46f1-99b1-1ba4a2dda7e1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:42:58.966506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3840a-0782-46f1-99b1-1ba4a2dda7e1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:42:58.972484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:42:58.973144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:42:58.973415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:42:58.973873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:42:58.994450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:42:58.997106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362394d5-935c-4de1-b3a4-931bb1020b6b service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:42:59.014613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 688/1406] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:01.648663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357650d-74ca-4cde-8cd2-e1d9d2fa8559 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:01.649239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357650d-74ca-4cde-8cd2-e1d9d2fa8559 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:01.649239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357650d-74ca-4cde-8cd2-e1d9d2fa8559 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:01.650627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 719/1407] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:01.657850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2682-17cf-4297-80b5-84f6293dcae7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:01.658386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2682-17cf-4297-80b5-84f6293dcae7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:01.658481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2682-17cf-4297-80b5-84f6293dcae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:01.676734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2d6a2682-17cf-4297-80b5-84f6293dcae7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:01.678333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2d6a2682-17cf-4297-80b5-84f6293dcae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:01.686574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 689/1408] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:01.730549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357650d-74ca-4cde-8cd2-e1d9d2fa8559 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:01.747357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357650d-74ca-4cde-8cd2-e1d9d2fa8559 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:01.752967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:01.753818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:01.754096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:01.754367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:01.763790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:01.765393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c74f3-4b0f-4c08-aa55-a8b8c312b69b service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:01.777740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 720/1409] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:22.910337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2cdd4-0145-4e16-88e6-2acbbe2fe6e1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:22.911050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2cdd4-0145-4e16-88e6-2acbbe2fe6e1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:22.911050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2cdd4-0145-4e16-88e6-2acbbe2fe6e1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:22.912576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 690/1410] 10.222.0.21 () {54 vars in 918 bytes} [Wed May 4 14:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:22.919160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51efdf-4289-473e-b8d6-16059ad9dc8c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:22.919782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51efdf-4289-473e-b8d6-16059ad9dc8c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:22.919782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51efdf-4289-473e-b8d6-16059ad9dc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:22.939411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ce51efdf-4289-473e-b8d6-16059ad9dc8c None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:22.940834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ce51efdf-4289-473e-b8d6-16059ad9dc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:22.951386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 721/1411] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:22.966291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2506-5a78-4772-8dc8-a21bfa274fe8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:22.966581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2506-5a78-4772-8dc8-a21bfa274fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:22.966858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2506-5a78-4772-8dc8-a21bfa274fe8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:22.968283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 691/1412] 10.222.0.21 () {54 vars in 918 bytes} [Wed May 4 14:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:22.973310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c4eb-964f-40bc-a0fa-10d8611829a5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:22.973636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c4eb-964f-40bc-a0fa-10d8611829a5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:22.973957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c4eb-964f-40bc-a0fa-10d8611829a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:22.993071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a376c4eb-964f-40bc-a0fa-10d8611829a5 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:22.994309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a376c4eb-964f-40bc-a0fa-10d8611829a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:23.003688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 722/1413] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:25.760952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f46d-809d-4f27-98d4-15c2c9083fc6 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:25.761599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f46d-809d-4f27-98d4-15c2c9083fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:25.761599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f46d-809d-4f27-98d4-15c2c9083fc6 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:25.762884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 692/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:25.768946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80cc4-53f9-4a2c-9750-e1d36d1104e4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:25.769403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80cc4-53f9-4a2c-9750-e1d36d1104e4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:25.769533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80cc4-53f9-4a2c-9750-e1d36d1104e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:25.792185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-cba80cc4-53f9-4a2c-9750-e1d36d1104e4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:25.793451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cba80cc4-53f9-4a2c-9750-e1d36d1104e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:25.804048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 723/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:25.847069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f46d-809d-4f27-98d4-15c2c9083fc6 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:25.867111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f46d-809d-4f27-98d4-15c2c9083fc6 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:25.874147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:25.874828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:25.875103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:25.875339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:25.885175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:25.886790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4305e-e02d-46d4-9293-6e5447b27e5c service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:25.897083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 693/1416] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:27.226644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b820-1120-460c-9022-a608abc92929 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:27.227304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b820-1120-460c-9022-a608abc92929 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:27.227304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b820-1120-460c-9022-a608abc92929 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:27.228680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 724/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:27.236460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a40f8-45ce-43ae-8f44-73e1922969de None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:27.237022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a40f8-45ce-43ae-8f44-73e1922969de None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:27.237399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a40f8-45ce-43ae-8f44-73e1922969de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:27.260759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-415a40f8-45ce-43ae-8f44-73e1922969de None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:27.261981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-415a40f8-45ce-43ae-8f44-73e1922969de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:27.271099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 694/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:27.444496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b820-1120-460c-9022-a608abc92929 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:27.460401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b820-1120-460c-9022-a608abc92929 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:27.466537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:27.467195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:27.467477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:27.467778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:27.476865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:27.478433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32849080-58a8-4c9a-96cf-a72a795bd1f1 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:27.488371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 725/1419] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:28.792383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bae7-9e21-4022-86a8-7e28ce0f4001 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:28.793011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bae7-9e21-4022-86a8-7e28ce0f4001 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:28.793011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bae7-9e21-4022-86a8-7e28ce0f4001 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:28.794310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 695/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:43:28.799969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2316-1fc0-48a7-92d4-ec800fc99f04 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:28.800627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2316-1fc0-48a7-92d4-ec800fc99f04 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:28.800627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2316-1fc0-48a7-92d4-ec800fc99f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:28.820058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-54dc2316-1fc0-48a7-92d4-ec800fc99f04 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:28.821443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-54dc2316-1fc0-48a7-92d4-ec800fc99f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:28.831369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 726/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:28.982661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690bae7-9e21-4022-86a8-7e28ce0f4001 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:28.998870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690bae7-9e21-4022-86a8-7e28ce0f4001 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:29.006583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:29.007339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:29.007815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:29.008268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:29.020603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:29.023308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7537c-05ba-4f4b-9350-9a3cd5eac3fe service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:29.039511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 696/1422] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:30.316357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735689ac-4c3c-48c2-b5cd-3f69dd2f9659 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:30.317208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735689ac-4c3c-48c2-b5cd-3f69dd2f9659 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:30.317375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735689ac-4c3c-48c2-b5cd-3f69dd2f9659 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:30.318840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 727/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:30.324999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511175fe-1825-4ae0-acf6-2231f5d637c2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:30.325690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511175fe-1825-4ae0-acf6-2231f5d637c2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:30.325690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511175fe-1825-4ae0-acf6-2231f5d637c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:30.351695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-511175fe-1825-4ae0-acf6-2231f5d637c2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:30.353878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-511175fe-1825-4ae0-acf6-2231f5d637c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:30.367035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 697/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:30.521741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735689ac-4c3c-48c2-b5cd-3f69dd2f9659 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:30.537943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735689ac-4c3c-48c2-b5cd-3f69dd2f9659 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:30.544252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:30.544916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:30.545197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:30.545469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:30.555447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:30.557097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a09a9-9c42-4b71-8eef-81e9241a343d service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:30.568047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 728/1425] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:32.384426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736555d1-b16a-49b8-8188-dd8473109293 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:32.385016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736555d1-b16a-49b8-8188-dd8473109293 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:32.385016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736555d1-b16a-49b8-8188-dd8473109293 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:32.386517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 698/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:32.392235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d3ac-54d6-49ab-82ba-689f77031713 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:32.392886 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d3ac-54d6-49ab-82ba-689f77031713 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:32.392886 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d3ac-54d6-49ab-82ba-689f77031713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:32.413888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b367d3ac-54d6-49ab-82ba-689f77031713 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:32.415254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b367d3ac-54d6-49ab-82ba-689f77031713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:32.424401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 729/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:32.577783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736555d1-b16a-49b8-8188-dd8473109293 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:32.594468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736555d1-b16a-49b8-8188-dd8473109293 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:32.601146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:32.601985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:32.602274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:32.602559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:32.612332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:32.614044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47533b2-1221-4d71-b86c-e7873fd8166b service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:32.624554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 699/1428] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:33.882080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1174-14e2-4c74-8529-9c4c99b3793b None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:33.883102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1174-14e2-4c74-8529-9c4c99b3793b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:33.883102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1174-14e2-4c74-8529-9c4c99b3793b None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:33.884174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 730/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:33.889820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbb39-666b-4b29-8102-b34273f97916 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:33.890377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbb39-666b-4b29-8102-b34273f97916 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:33.890377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbb39-666b-4b29-8102-b34273f97916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:33.910203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9b6dbb39-666b-4b29-8102-b34273f97916 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:33.911420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9b6dbb39-666b-4b29-8102-b34273f97916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:33.920250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 700/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:34.071338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e1174-14e2-4c74-8529-9c4c99b3793b None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:34.087867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e1174-14e2-4c74-8529-9c4c99b3793b None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:34.093795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:34.094468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:34.094746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:34.095021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:34.104640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:34.106446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319814-b37f-4d74-b4f7-0f29caae10b0 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:34.117620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 731/1431] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:35.368904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca430e-6970-4dae-b18d-7f7696c5ede2 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:35.369553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca430e-6970-4dae-b18d-7f7696c5ede2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:35.369553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca430e-6970-4dae-b18d-7f7696c5ede2 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:35.370777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 701/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:35.377087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03483-5013-48af-ae6d-23694cfbc08e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:35.377578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03483-5013-48af-ae6d-23694cfbc08e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:35.378043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03483-5013-48af-ae6d-23694cfbc08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:35.409836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-97a03483-5013-48af-ae6d-23694cfbc08e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:35.411940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-97a03483-5013-48af-ae6d-23694cfbc08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:35.426067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 732/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:35.579138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca430e-6970-4dae-b18d-7f7696c5ede2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:35.595614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca430e-6970-4dae-b18d-7f7696c5ede2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:35.601847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:35.602549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:35.602873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:35.603088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:35.612426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:35.614091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e67b1c-0152-4445-b89a-bcd18d266515 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:35.624730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 702/1434] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:36.839536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d424-5a23-4850-b034-9a517cf71b6e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:36.840396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d424-5a23-4850-b034-9a517cf71b6e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:36.840530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d424-5a23-4850-b034-9a517cf71b6e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:36.843203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 733/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:36.849814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f152-7588-4271-8093-519272ce9d44 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:36.850569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f152-7588-4271-8093-519272ce9d44 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:36.850934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f152-7588-4271-8093-519272ce9d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:36.875322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5899f152-7588-4271-8093-519272ce9d44 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:36.876788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5899f152-7588-4271-8093-519272ce9d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:36.885426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 703/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:37.063337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d424-5a23-4850-b034-9a517cf71b6e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:37.081993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d424-5a23-4850-b034-9a517cf71b6e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:37.088380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:37.089209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:37.089606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:37.089857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:37.099843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:37.101556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74c796-12d0-448b-8133-aa6dbb39182c service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:37.112901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 734/1437] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:38.437324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de0487-259d-4169-a648-e67cdb9f272c None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:38.438147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de0487-259d-4169-a648-e67cdb9f272c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:38.438147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de0487-259d-4169-a648-e67cdb9f272c None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:38.439246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 704/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:38.445361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9deda-2645-4b5e-be5b-09a35b61af69 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:38.446104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9deda-2645-4b5e-be5b-09a35b61af69 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:38.446104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9deda-2645-4b5e-be5b-09a35b61af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:38.465514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-44d9deda-2645-4b5e-be5b-09a35b61af69 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:38.466730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-44d9deda-2645-4b5e-be5b-09a35b61af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:38.475380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 735/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:38.624255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de0487-259d-4169-a648-e67cdb9f272c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:38.640761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de0487-259d-4169-a648-e67cdb9f272c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:38.646671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:38.647336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:38.647618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:38.647926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:38.657757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:38.659407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c6607-71a2-4d92-a673-63164627a982 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:38.669190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 705/1440] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:40.831638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5af92-c02f-4d59-a62d-49fb4b532f19 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:40.832247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5af92-c02f-4d59-a62d-49fb4b532f19 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:40.832247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5af92-c02f-4d59-a62d-49fb4b532f19 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:40.833644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 736/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:40.839139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396df9-0a03-4551-9707-014f989e1f38 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:40.839657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396df9-0a03-4551-9707-014f989e1f38 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:40.839657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396df9-0a03-4551-9707-014f989e1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:40.858514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-24396df9-0a03-4551-9707-014f989e1f38 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:40.859789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-24396df9-0a03-4551-9707-014f989e1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:40.868633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 706/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:40.907443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5af92-c02f-4d59-a62d-49fb4b532f19 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:40.919580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5af92-c02f-4d59-a62d-49fb4b532f19 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:40.923659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:40.924373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:40.924633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:40.924901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:40.935046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:40.936552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3ef2-5f11-40b7-b95c-db59ddb92b5e service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:40.946606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 737/1443] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:43.407541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58e69-d34c-47a6-8bc8-4e2dbf326be0 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:43.408238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58e69-d34c-47a6-8bc8-4e2dbf326be0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:43.408238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58e69-d34c-47a6-8bc8-4e2dbf326be0 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:43.409488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 707/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:43.415326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954fcb6-ddab-4ede-9bc3-c093600c8ecc None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:43.415891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954fcb6-ddab-4ede-9bc3-c093600c8ecc None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:43.415891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954fcb6-ddab-4ede-9bc3-c093600c8ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:43.435596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e954fcb6-ddab-4ede-9bc3-c093600c8ecc None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:43.436921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e954fcb6-ddab-4ede-9bc3-c093600c8ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:43.444889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 738/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:43.486412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58e69-d34c-47a6-8bc8-4e2dbf326be0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:43.497889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58e69-d34c-47a6-8bc8-4e2dbf326be0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:43.501538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:43.502185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:43.502465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:43.502732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:43.512924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:43.514426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809a4a-c1b3-4a11-8725-90ee7c5b44ae service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:43.524820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 708/1446] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:46.116741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d13d5-1ed8-4e5d-b1af-c50a855e518f None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:46.117569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d13d5-1ed8-4e5d-b1af-c50a855e518f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:46.117569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d13d5-1ed8-4e5d-b1af-c50a855e518f None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:46.118725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 739/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:46.124936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec901a-e828-4ce3-b60a-a2e5aa369add None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:46.125444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec901a-e828-4ce3-b60a-a2e5aa369add None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:46.125444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec901a-e828-4ce3-b60a-a2e5aa369add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:46.144245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2fec901a-e828-4ce3-b60a-a2e5aa369add None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:46.145456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2fec901a-e828-4ce3-b60a-a2e5aa369add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:46.154547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 709/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:46.193127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d13d5-1ed8-4e5d-b1af-c50a855e518f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:46.206475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d13d5-1ed8-4e5d-b1af-c50a855e518f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:46.210606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:46.211359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:46.211632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:46.211924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:46.221752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:46.223189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240878f3-853d-404f-9784-212ab55d539d service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:46.233153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 740/1449] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:48.665847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561b23-3d40-47a9-87ff-4b8d9bdbb208 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:48.666454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561b23-3d40-47a9-87ff-4b8d9bdbb208 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:48.666454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561b23-3d40-47a9-87ff-4b8d9bdbb208 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:48.667781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 710/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:48.673214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065256ee-4d85-43b8-ba89-6aced08b9c47 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:48.673701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065256ee-4d85-43b8-ba89-6aced08b9c47 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:48.673701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065256ee-4d85-43b8-ba89-6aced08b9c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:48.693174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-065256ee-4d85-43b8-ba89-6aced08b9c47 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:48.694390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-065256ee-4d85-43b8-ba89-6aced08b9c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:48.703892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 741/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:48.743418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41561b23-3d40-47a9-87ff-4b8d9bdbb208 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:48.756235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41561b23-3d40-47a9-87ff-4b8d9bdbb208 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:48.760569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:48.761244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:48.761514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:48.761779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:48.771629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:48.773125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0e799-ad54-4821-ba21-af153ac07bad service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:48.783332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 711/1452] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:43:51.293597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd4e5-1c62-4fe5-abdc-b4d7ea2adb5e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:51.294219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd4e5-1c62-4fe5-abdc-b4d7ea2adb5e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:51.294219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd4e5-1c62-4fe5-abdc-b4d7ea2adb5e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:51.295590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 742/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:51.301255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da164-f96b-458e-ba91-9679a08a00c9 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:51.301700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da164-f96b-458e-ba91-9679a08a00c9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:51.301804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da164-f96b-458e-ba91-9679a08a00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:51.320923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-066da164-f96b-458e-ba91-9679a08a00c9 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:51.322159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-066da164-f96b-458e-ba91-9679a08a00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:51.331638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 712/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:51.370798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd4e5-1c62-4fe5-abdc-b4d7ea2adb5e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:51.383154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd4e5-1c62-4fe5-abdc-b4d7ea2adb5e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:51.387592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:51.388267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:51.388554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:51.388824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:51.398628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:51.400131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0013b6-afb2-43a1-8add-e5744cbdf198 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:51.410291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 743/1455] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:53.734326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80304e-7a2f-4c8a-97d6-940b4832b0de None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:53.734911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80304e-7a2f-4c8a-97d6-940b4832b0de None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:53.734911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80304e-7a2f-4c8a-97d6-940b4832b0de None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:53.736252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 713/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:53.741653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f8a0-4dcf-4673-8d3b-e64ffdf6680c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:53.742201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f8a0-4dcf-4673-8d3b-e64ffdf6680c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:53.742305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f8a0-4dcf-4673-8d3b-e64ffdf6680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:53.760393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-aca5f8a0-4dcf-4673-8d3b-e64ffdf6680c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:53.761701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-aca5f8a0-4dcf-4673-8d3b-e64ffdf6680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:53.771262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 744/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:43:53.810044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80304e-7a2f-4c8a-97d6-940b4832b0de None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:53.821496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80304e-7a2f-4c8a-97d6-940b4832b0de None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:53.825216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:53.825855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:53.826137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:53.826409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:53.835957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:53.837427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45a49-d79b-4ce1-b918-5d4a20a3d5d3 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:53.847155 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 714/1458] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:56.185620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535d29-529e-4f4a-be8e-b27e9f787937 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:56.186247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535d29-529e-4f4a-be8e-b27e9f787937 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:56.186247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535d29-529e-4f4a-be8e-b27e9f787937 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:56.187563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 745/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:56.193456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a09dd-4d59-41b6-9caa-59a916d7fc76 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:56.193991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a09dd-4d59-41b6-9caa-59a916d7fc76 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:56.194090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a09dd-4d59-41b6-9caa-59a916d7fc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:56.212354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-312a09dd-4d59-41b6-9caa-59a916d7fc76 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:56.213558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-312a09dd-4d59-41b6-9caa-59a916d7fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:56.221779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 715/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:56.259488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91535d29-529e-4f4a-be8e-b27e9f787937 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:56.271936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91535d29-529e-4f4a-be8e-b27e9f787937 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:56.275895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:56.276890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:56.277164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:56.277437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:56.287170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:56.288657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7c96-6fac-4f3e-8f59-58c87bf50828 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:56.298679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 746/1461] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:43:58.659405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f8bf-faff-4786-abc8-82d159d457c1 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:58.660041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f8bf-faff-4786-abc8-82d159d457c1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:58.660041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f8bf-faff-4786-abc8-82d159d457c1 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:58.661352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 716/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:43:58.667513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e858f-b5c8-4f68-b22c-ce56b49cd8b9 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:58.668060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e858f-b5c8-4f68-b22c-ce56b49cd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:58.668060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e858f-b5c8-4f68-b22c-ce56b49cd8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:58.688181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-535e858f-b5c8-4f68-b22c-ce56b49cd8b9 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:43:58.689395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-535e858f-b5c8-4f68-b22c-ce56b49cd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:43:58.699176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 747/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:43:58.737162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f8bf-faff-4786-abc8-82d159d457c1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:43:58.748614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f8bf-faff-4786-abc8-82d159d457c1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:43:58.752597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:43:58.753304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:43:58.753580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:43:58.753850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:43:58.764012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:43:58.765514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00e83-38d5-4483-8b08-86d83769b352 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:43:58.776619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 717/1464] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:01.059405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681e95-676c-44c4-8f18-7db4087dd339 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:01.060012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681e95-676c-44c4-8f18-7db4087dd339 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:01.060012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681e95-676c-44c4-8f18-7db4087dd339 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:01.061351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 748/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:01.066814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4b6b-dc68-4a9a-a486-1eb170a52983 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:01.067322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4b6b-dc68-4a9a-a486-1eb170a52983 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:01.067322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4b6b-dc68-4a9a-a486-1eb170a52983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:01.085530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d64f4b6b-dc68-4a9a-a486-1eb170a52983 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:01.086753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d64f4b6b-dc68-4a9a-a486-1eb170a52983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:01.095131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 718/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:01.131093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681e95-676c-44c4-8f18-7db4087dd339 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:01.143502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681e95-676c-44c4-8f18-7db4087dd339 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:01.147354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:01.148025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:01.148355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:01.148613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:01.159301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:01.160777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d707-6b88-42f8-b586-38a57d86fc56 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:01.170308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 749/1467] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:03.439903 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b3d9-149c-498d-a7d2-fb06b8b18287 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:03.440497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b3d9-149c-498d-a7d2-fb06b8b18287 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:03.440497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b3d9-149c-498d-a7d2-fb06b8b18287 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:03.441986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 719/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:03.447424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5509-25b2-4e04-b1dc-fda2d222fd31 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:03.448562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5509-25b2-4e04-b1dc-fda2d222fd31 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:03.448853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5509-25b2-4e04-b1dc-fda2d222fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:03.467717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-467a5509-25b2-4e04-b1dc-fda2d222fd31 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:03.469030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-467a5509-25b2-4e04-b1dc-fda2d222fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:03.477501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 750/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:03.513563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b3d9-149c-498d-a7d2-fb06b8b18287 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:03.525420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b3d9-149c-498d-a7d2-fb06b8b18287 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:03.529638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:03.530276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:03.530578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:03.530845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:03.540673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:03.542799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17435676-b172-4d92-9fb6-667f0c5bc0cd service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:03.554348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 720/1470] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:37.471708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0e66c-e02f-43dd-b4ea-0585e28f5ece None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:37.472357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0e66c-e02f-43dd-b4ea-0585e28f5ece None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:37.472474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0e66c-e02f-43dd-b4ea-0585e28f5ece None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:37.474352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 751/1471] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:37.480706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fcb7-c298-40fb-b511-0b4b666450cd None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:37.481255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fcb7-c298-40fb-b511-0b4b666450cd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:37.481255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fcb7-c298-40fb-b511-0b4b666450cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:37.501642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e517fcb7-c298-40fb-b511-0b4b666450cd None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:37.502941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e517fcb7-c298-40fb-b511-0b4b666450cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:37.512528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 721/1472] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:37.562995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88d38-ba3d-4895-8371-19f10e53b134 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:37.563264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88d38-ba3d-4895-8371-19f10e53b134 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:37.563537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88d38-ba3d-4895-8371-19f10e53b134 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:37.565023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 752/1473] 10.222.0.21 () {54 vars in 962 bytes} [Wed May 4 14:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:37.571226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753aed6-112c-4330-bef7-191304cf3a1a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:37.571512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753aed6-112c-4330-bef7-191304cf3a1a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:37.571821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753aed6-112c-4330-bef7-191304cf3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:37.592467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9753aed6-112c-4330-bef7-191304cf3a1a None None] MFA Rules not processed for user `3408c447488e472399394fdd26215a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:37.593678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9753aed6-112c-4330-bef7-191304cf3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:37.600797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 722/1474] 10.222.0.21 () {58 vars in 1059 bytes} [Wed May 4 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:37.609179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88d38-ba3d-4895-8371-19f10e53b134 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:37.621616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88d38-ba3d-4895-8371-19f10e53b134 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:37.625816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:37.626481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:37.626761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:37.627033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:37.637330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:37.638783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd48ee7-1ee4-44c9-a5dd-1e170ac3b785 service glance] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:37.649908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 753/1475] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:40.060770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2739-a5a8-45ac-a1fb-dda32725f3a8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:40.061363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2739-a5a8-45ac-a1fb-dda32725f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:40.061363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2739-a5a8-45ac-a1fb-dda32725f3a8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:40.062660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 723/1476] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:40.068665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325144-584c-4a3a-9f80-562b90b9b5c8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:40.069245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325144-584c-4a3a-9f80-562b90b9b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:40.069388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325144-584c-4a3a-9f80-562b90b9b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:40.088644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6e325144-584c-4a3a-9f80-562b90b9b5c8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:40.089873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6e325144-584c-4a3a-9f80-562b90b9b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:40.098848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 754/1477] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:44:40.121999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e2739-a5a8-45ac-a1fb-dda32725f3a8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:40.136871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e2739-a5a8-45ac-a1fb-dda32725f3a8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:40.142450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:40.143139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:40.143419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:40.143651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:40.144459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:40.146283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:44:40.146283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:44:40.146283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:44:40.147561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d8f5b-ba6f-44e7-a39f-e8ddcda08ab4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:40.169180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 724/1478] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 14:44:40 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:44:42.490395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2007b-1b32-4b7d-a987-9a637f3784e7 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:42.491038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2007b-1b32-4b7d-a987-9a637f3784e7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:42.491038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2007b-1b32-4b7d-a987-9a637f3784e7 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:42.492582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 755/1479] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:42.498674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de45c3-2323-4d9c-8949-5d4c148132ff None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:42.499203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de45c3-2323-4d9c-8949-5d4c148132ff None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:42.499203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de45c3-2323-4d9c-8949-5d4c148132ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:42.518672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a3de45c3-2323-4d9c-8949-5d4c148132ff None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:42.520039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a3de45c3-2323-4d9c-8949-5d4c148132ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:42.529190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 725/1480] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:42.572544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2007b-1b32-4b7d-a987-9a637f3784e7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:42.587245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2007b-1b32-4b7d-a987-9a637f3784e7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:42.593470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:42.594049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:42.594322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:42.594572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:42.604851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:42.606698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193ea44-f3b1-463c-b77a-ae75e3f9dfd2 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:42.617126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 756/1481] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:45.122188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8deee2-bd9e-4db7-a114-3a5edf430660 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:45.122845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8deee2-bd9e-4db7-a114-3a5edf430660 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:45.122845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8deee2-bd9e-4db7-a114-3a5edf430660 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:45.124263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 726/1482] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:45.130275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98f62-5040-408a-9aa1-7f864b0c7906 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:45.130731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98f62-5040-408a-9aa1-7f864b0c7906 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:45.130935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98f62-5040-408a-9aa1-7f864b0c7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:45.149931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6ac98f62-5040-408a-9aa1-7f864b0c7906 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:45.151431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6ac98f62-5040-408a-9aa1-7f864b0c7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:45.160683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 757/1483] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:45.197244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8deee2-bd9e-4db7-a114-3a5edf430660 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:45.208258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8deee2-bd9e-4db7-a114-3a5edf430660 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:45.212053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:45.212709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:45.212993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:45.213264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:45.222672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:45.224215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bb23a-4f56-48bb-97df-5752cd59fcc6 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:45.234349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 727/1484] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:47.568315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68d45-3333-4505-b702-d144dc95e7d7 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:47.569243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68d45-3333-4505-b702-d144dc95e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:47.569427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68d45-3333-4505-b702-d144dc95e7d7 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:47.570861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 758/1485] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:47.576586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd65ee-d591-4bd9-81d4-5d1d5404001b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:47.577085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd65ee-d591-4bd9-81d4-5d1d5404001b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:47.577085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd65ee-d591-4bd9-81d4-5d1d5404001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:47.597472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f9fd65ee-d591-4bd9-81d4-5d1d5404001b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:47.598736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f9fd65ee-d591-4bd9-81d4-5d1d5404001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:47.607266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 728/1486] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:44:47.644299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68d45-3333-4505-b702-d144dc95e7d7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:47.656680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68d45-3333-4505-b702-d144dc95e7d7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:47.661609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:47.662304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:47.662571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:47.662853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:47.673252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:47.674736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5778d-0b47-43d7-8300-bd5798c3dc40 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:47.685050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 759/1487] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:50.155402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a240-9d58-4c64-9e1d-7d96fff37753 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:50.156319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a240-9d58-4c64-9e1d-7d96fff37753 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:50.156319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a240-9d58-4c64-9e1d-7d96fff37753 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:50.157853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 729/1488] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:44:50.163595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407099d-6826-4528-a47c-79b9f39d9181 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:50.164392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407099d-6826-4528-a47c-79b9f39d9181 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:50.164572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407099d-6826-4528-a47c-79b9f39d9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:50.184286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5407099d-6826-4528-a47c-79b9f39d9181 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:50.185520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5407099d-6826-4528-a47c-79b9f39d9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:50.194570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 760/1489] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:50.238995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a240-9d58-4c64-9e1d-7d96fff37753 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:50.251565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a240-9d58-4c64-9e1d-7d96fff37753 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:50.255965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:50.256767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:50.257052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:50.257329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:50.267461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:50.268968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19984047-bf98-4ffa-8a3c-67a3e54ecb41 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:50.279144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 730/1490] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:44:53.413801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe782de-b05f-47cd-9673-182ff20d3a76 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:53.414382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe782de-b05f-47cd-9673-182ff20d3a76 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:53.414566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe782de-b05f-47cd-9673-182ff20d3a76 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:53.416389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 761/1491] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 14:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:44:53.423153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9d00-e0a4-48dd-9583-d3e65e3edb23 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:53.423686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9d00-e0a4-48dd-9583-d3e65e3edb23 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:53.423785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9d00-e0a4-48dd-9583-d3e65e3edb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:53.442684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-28de9d00-e0a4-48dd-9583-d3e65e3edb23 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:44:53.443933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28de9d00-e0a4-48dd-9583-d3e65e3edb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:44:53.453204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 731/1492] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:44:53.502014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe782de-b05f-47cd-9673-182ff20d3a76 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:44:53.514989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe782de-b05f-47cd-9673-182ff20d3a76 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:44:53.519350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:44:53.520119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:44:53.520446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:44:53.520787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:44:53.532178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:44:53.533876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7da07-1b20-445b-8a59-6376c1c6b038 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:44:53.545710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 762/1493] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:46:27.961625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:27.962268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:27.962268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:27.982533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:46:27.983807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:27.993294 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 732/1494] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:46:28.002424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.002958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.003061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.022631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:46:28.023862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:28.032771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 763/1495] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:46:28.037631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.047605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50c1b-1961-49df-a6c9-ea7db74f4eb1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.053355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.054062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.054340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.054610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.055362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:46:28.055694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.056789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.056789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:46:28.056789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:46:28.057711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.071142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 733/1496] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:46:28.079848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.089601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb36ca-c5b0-43f4-abfc-b93642e93166 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.095543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.096253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.096533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.096801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.097516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.099456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.099456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:46:28.099456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:46:28.100715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.137877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 764/1497] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:46:28 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:46:28.142286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.153004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbfcf3-1df5-44c0-858c-e042c67b5eae admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.211032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.211796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.212027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.212300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.213001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.214055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.214055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:46:28.214055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:46:28.215280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.236295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 734/1498] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:46:28 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:46:28.240840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.251481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb605b-029b-4e12-aca8-d613b7afb7c7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.256274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.256926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.257205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.257478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.258199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.259236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.259236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:46:28.259236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:46:28.260132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.272793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 765/1499] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:46:28.277368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.287576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973067-8fe3-4efe-a030-cd679180cc2e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.292657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.293326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.293606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.293876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.294644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.295647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.295647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:46:28.295647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:46:28.296612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ca49-d58f-4ff0-90a7-4bd58e57f83f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.311012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 735/1500] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:46:28.317182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.327259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aab9-7c96-4b14-86ef-67c503b776ac admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.332072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.333132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.333403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.333674 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] PATH_INFO: `/v3/projects/4f4238b1920645ba8caa34042b7736b4/users/f2b16c916a5845f9aadb1f48b50a7743/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.349009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4238b1920645ba8caa34042b7736b4, user_id=f2b16c916a5845f9aadb1f48b50a7743, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.350049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.350049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:46:28.350049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:46:28.351984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.366668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 766/1501] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:46:28 2022] PUT /identity/v3/projects/4f4238b1920645ba8caa34042b7736b4/users/f2b16c916a5845f9aadb1f48b50a7743/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:46:28.378431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274feb6-4c7c-4391-b89d-fdea95389a0a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.378720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274feb6-4c7c-4391-b89d-fdea95389a0a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.378999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274feb6-4c7c-4391-b89d-fdea95389a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.406308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3274feb6-4c7c-4391-b89d-fdea95389a0a None None] MFA Rules not processed for user `f2b16c916a5845f9aadb1f48b50a7743`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:46:28.407597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3274feb6-4c7c-4391-b89d-fdea95389a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:28.471729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 736/1502] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:46:28.482966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.552319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2d2e-01b6-4a20-b40d-b59e4a84b866 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.557968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.558616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.558892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.559162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.567260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.568897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.577520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 767/1503] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:46:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:46:28.648165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39720-6385-42db-a70f-bd7aa989327a None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.648444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39720-6385-42db-a70f-bd7aa989327a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.648718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39720-6385-42db-a70f-bd7aa989327a None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.650019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 737/1504] 10.222.0.21 () {52 vars in 829 bytes} [Wed May 4 14:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:46:28.654351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:28.720691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25986109-d8b1-4eda-9fe9-fa3da81a3bf4 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:28.726122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:28.726932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.727214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.727472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] PATH_INFO: `/v3/users/f2b16c916a5845f9aadb1f48b50a7743` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:28.728787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b16c916a5845f9aadb1f48b50a7743)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:28.729812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:28.729812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:46:28.729812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:46:28.731147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:28.933454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b16c916a5845f9aadb1f48b50a7743'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:28.942667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b16c916a5845f9aadb1f48b50a7743'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:28.956179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b16c916a5845f9aadb1f48b50a7743'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:28.975904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b16c916a5845f9aadb1f48b50a7743'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:28.976781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b16c916a5845f9aadb1f48b50a7743'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:28.982996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 768/1505] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:46:28 2022] DELETE /identity/v3/users/f2b16c916a5845f9aadb1f48b50a7743 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:46:28.987802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:28.988346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:28.988453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:29.006735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:46:29.007947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:29.075749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 738/1506] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:46:29.085836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:29.087360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:29.152950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33728-6a53-48fa-902b-12e1299a422a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:29.157166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:29.157816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:29.158103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:29.158380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:29.167997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:29.169463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9aaa1-c46d-4c36-9746-223874a19cb4 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:29.179049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 769/1507] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:46:29.533665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:46:29.535108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:46:29.547113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa138f3-142c-40a7-8b1e-342aad18ed61 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:46:29.557117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:46:29.558007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:46:29.558280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:46:29.558535 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] PATH_INFO: `/v3/projects/4f4238b1920645ba8caa34042b7736b4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:46:29.559952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4238b1920645ba8caa34042b7736b4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:46:29.561055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:46:29.561055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:46:29.561055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:46:29.562252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:46:29.622879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4238b1920645ba8caa34042b7736b4', 'request_id': 'req-9924193c-16c0-4ec7-8c8e-722b3e0617da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:29.636097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4238b1920645ba8caa34042b7736b4', 'request_id': 'req-9924193c-16c0-4ec7-8c8e-722b3e0617da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:29.646602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4238b1920645ba8caa34042b7736b4', 'request_id': 'req-9924193c-16c0-4ec7-8c8e-722b3e0617da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:29.658382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] The token cache is being invalidate because project 4f4238b1920645ba8caa34042b7736b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:46:29.658659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:29.659314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9924193c-16c0-4ec7-8c8e-722b3e0617da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:46:29.661005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 739/1508] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:46:29 2022] DELETE /identity/v3/projects/4f4238b1920645ba8caa34042b7736b4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:48:17.504707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:17.505255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:17.505255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:17.506673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 770/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:17.512232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ff25-6e83-44d1-a5db-8283a10c46cf None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:17.512788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ff25-6e83-44d1-a5db-8283a10c46cf None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:17.512788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ff25-6e83-44d1-a5db-8283a10c46cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:17.537522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4c99ff25-6e83-44d1-a5db-8283a10c46cf None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:17.538772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4c99ff25-6e83-44d1-a5db-8283a10c46cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:17.601362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 740/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:17.750950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:17.752978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:17.830281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02eb5e-951b-4c10-8a0f-ae0f2779f8ed None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:17.836290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:17.836938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:17.837213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:17.837482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:17.846926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:17.848705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f854-1bdc-4657-8f90-26393aa4cd4f service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:17.858648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 771/1511] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:18.634620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd7299-c807-443a-9ad9-53e8abdf6dee None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:18.635250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd7299-c807-443a-9ad9-53e8abdf6dee None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:18.635353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd7299-c807-443a-9ad9-53e8abdf6dee None None] PATH_INFO: `/v3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:18.636659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 741/1512] 10.222.0.43 () {54 vars in 925 bytes} [Wed May 4 14:48:18 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:48:18.645553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d4d9-ed84-4e99-a42b-2b286a6d125e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:18.646103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d4d9-ed84-4e99-a42b-2b286a6d125e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:18.646278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d4d9-ed84-4e99-a42b-2b286a6d125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:18.670602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b5b2d4d9-ed84-4e99-a42b-2b286a6d125e None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:18.671860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b5b2d4d9-ed84-4e99-a42b-2b286a6d125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:18.740036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 772/1513] 10.222.0.43 () {58 vars in 1015 bytes} [Wed May 4 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:19.112004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a01b4-db6e-474a-b3a2-82d6d0467859 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:19.112290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a01b4-db6e-474a-b3a2-82d6d0467859 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:19.112578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a01b4-db6e-474a-b3a2-82d6d0467859 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:19.113945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 742/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:19.119637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ecb1-e2c7-42fb-a86c-1ee5308b22e6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:19.119950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ecb1-e2c7-42fb-a86c-1ee5308b22e6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:19.120211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ecb1-e2c7-42fb-a86c-1ee5308b22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:19.140400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-97c2ecb1-e2c7-42fb-a86c-1ee5308b22e6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:19.141599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-97c2ecb1-e2c7-42fb-a86c-1ee5308b22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:19.151215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 773/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:19.308289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a01b4-db6e-474a-b3a2-82d6d0467859 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:19.329007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a01b4-db6e-474a-b3a2-82d6d0467859 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:19.338261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:19.338993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:19.339487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:19.340022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:19.353996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:19.355712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fa169-2092-41c1-b0e3-bb55ba937d70 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:19.366255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 743/1516] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:22.783919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba1ac-c8a9-41cc-b556-72dc9a042eb7 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:22.784511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba1ac-c8a9-41cc-b556-72dc9a042eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:22.784914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba1ac-c8a9-41cc-b556-72dc9a042eb7 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:22.786763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 774/1517] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:48:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:22.793271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cba8aa-304d-4e5d-9594-bdecaac6ad7e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:22.793780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cba8aa-304d-4e5d-9594-bdecaac6ad7e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:22.793780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cba8aa-304d-4e5d-9594-bdecaac6ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:22.813427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-49cba8aa-304d-4e5d-9594-bdecaac6ad7e None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:22.814690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-49cba8aa-304d-4e5d-9594-bdecaac6ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:22.824668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 744/1518] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:22.832820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ba1ac-c8a9-41cc-b556-72dc9a042eb7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:22.848085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ba1ac-c8a9-41cc-b556-72dc9a042eb7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:22.853876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:22.854513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:22.854794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:22.855067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:22.863885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:22.865481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74082-582d-43cb-a36a-870558b68637 service placement] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:22.875555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 775/1519] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:30.991658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9941-edd2-482b-87a6-6e8f5a4ca579 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:30.992254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9941-edd2-482b-87a6-6e8f5a4ca579 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:30.992254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9941-edd2-482b-87a6-6e8f5a4ca579 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:30.993540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 745/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:30.998662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bfbc4-c1c4-4c3b-9e68-7a3832c40b56 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:30.999100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bfbc4-c1c4-4c3b-9e68-7a3832c40b56 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:30.999220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bfbc4-c1c4-4c3b-9e68-7a3832c40b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:31.018357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ca9bfbc4-c1c4-4c3b-9e68-7a3832c40b56 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:31.019801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ca9bfbc4-c1c4-4c3b-9e68-7a3832c40b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:31.029350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 776/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:31.180562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9941-edd2-482b-87a6-6e8f5a4ca579 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:31.196570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9941-edd2-482b-87a6-6e8f5a4ca579 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:31.202778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:31.203435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:31.203752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:31.204017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:31.212483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:31.214188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd971-5d76-4ca9-b450-00245c72a7f7 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:31.223940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 746/1522] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:32.430091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9c9-f5df-4cc3-9d98-34570e019784 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:32.430692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9c9-f5df-4cc3-9d98-34570e019784 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:32.430692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9c9-f5df-4cc3-9d98-34570e019784 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:32.432048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 777/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:32.437299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff415dc-8287-4b6d-a9a9-addc54d7aec0 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:32.437713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff415dc-8287-4b6d-a9a9-addc54d7aec0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:32.437884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff415dc-8287-4b6d-a9a9-addc54d7aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:32.457955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8ff415dc-8287-4b6d-a9a9-addc54d7aec0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:32.459240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8ff415dc-8287-4b6d-a9a9-addc54d7aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:32.468452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 747/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:32.618654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d9c9-f5df-4cc3-9d98-34570e019784 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:32.635065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d9c9-f5df-4cc3-9d98-34570e019784 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:32.641473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:32.642136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:32.642406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:32.642666 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:32.651211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:32.652827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47968e6-e69d-4312-8986-21f7aa2b4b97 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:32.662212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 778/1525] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:36.998579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:36.999198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:36.999198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:37.000596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 748/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:37.006101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109e11-3ffd-466a-bbe2-fe40418652ec None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:37.006599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109e11-3ffd-466a-bbe2-fe40418652ec None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:37.006599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109e11-3ffd-466a-bbe2-fe40418652ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:37.027344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-06109e11-3ffd-466a-bbe2-fe40418652ec None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:37.028533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-06109e11-3ffd-466a-bbe2-fe40418652ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:37.037077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 779/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:37.081412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:37.083509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:37.144874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aeed2-ba0f-4606-91cc-13179b438842 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:37.148705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:37.149350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:37.149632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:37.149905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:37.159747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:37.161219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4301a1-38bf-4ff4-b9b1-0a66510c499e service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:37.170750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 749/1528] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:39.428328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c73b-db3d-44fa-a625-91b13feb8ee4 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:39.428872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c73b-db3d-44fa-a625-91b13feb8ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:39.428997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c73b-db3d-44fa-a625-91b13feb8ee4 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:39.430301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 780/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:39.436193 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76bcd-38c8-4ee1-b529-6473956f7186 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:39.436646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76bcd-38c8-4ee1-b529-6473956f7186 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:39.436865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76bcd-38c8-4ee1-b529-6473956f7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:39.455702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-81b76bcd-38c8-4ee1-b529-6473956f7186 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:39.456973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-81b76bcd-38c8-4ee1-b529-6473956f7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:39.465584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 750/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:39.500688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c73b-db3d-44fa-a625-91b13feb8ee4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:39.513378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c73b-db3d-44fa-a625-91b13feb8ee4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:39.517627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:39.518221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:39.518583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:39.519284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:39.529405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:39.530840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1de81-13b5-47c0-9600-ec988bb7bb52 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:39.540673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 781/1531] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:43.520118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0781-0718-471e-be46-8b7a66748fba None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:43.520771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0781-0718-471e-be46-8b7a66748fba None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:43.520771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0781-0718-471e-be46-8b7a66748fba None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:43.522130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 751/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:43.528749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cf8b-3a94-41d0-8a55-94fa2af3c068 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:43.529223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cf8b-3a94-41d0-8a55-94fa2af3c068 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:43.529325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cf8b-3a94-41d0-8a55-94fa2af3c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:43.556427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2e19cf8b-3a94-41d0-8a55-94fa2af3c068 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:43.557648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2e19cf8b-3a94-41d0-8a55-94fa2af3c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:43.568358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 782/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:43.846972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0781-0718-471e-be46-8b7a66748fba None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:43.848935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-221b0781-0718-471e-be46-8b7a66748fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:43.913853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0781-0718-471e-be46-8b7a66748fba None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:43.918455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:43.919111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:43.919390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:43.919685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:43.930459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:43.931978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd305-b611-4b16-aeb2-dca538af359d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:43.942720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 752/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:48:46.224965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949811-7846-4116-b634-17d206a673b6 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:46.225540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949811-7846-4116-b634-17d206a673b6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:46.225540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949811-7846-4116-b634-17d206a673b6 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:46.226909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 783/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:46.232532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb92c-92ca-46a5-b99f-a7f985280e85 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:46.233046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb92c-92ca-46a5-b99f-a7f985280e85 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:46.233046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb92c-92ca-46a5-b99f-a7f985280e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:46.253246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-19fcb92c-92ca-46a5-b99f-a7f985280e85 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:46.254485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-19fcb92c-92ca-46a5-b99f-a7f985280e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:46.263151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 753/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:46.537941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae08fe-cbb1-409f-9ddb-7ef8c671d0df None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:46.538592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae08fe-cbb1-409f-9ddb-7ef8c671d0df None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:46.539265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae08fe-cbb1-409f-9ddb-7ef8c671d0df None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:46.543267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 784/1537] 10.222.0.21 () {54 vars in 963 bytes} [Wed May 4 14:48:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:48:46.552929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e29c-399e-4853-9fa5-f4a7234041a3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:46.553340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e29c-399e-4853-9fa5-f4a7234041a3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:46.553828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e29c-399e-4853-9fa5-f4a7234041a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:46.582274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6266e29c-399e-4853-9fa5-f4a7234041a3 None None] MFA Rules not processed for user `5cb06fb2f9574061859dc8e25ec44bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:48:46.583563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6266e29c-399e-4853-9fa5-f4a7234041a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:48:46.591807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 754/1538] 10.222.0.21 () {58 vars in 1060 bytes} [Wed May 4 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:48:46.599806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae08fe-cbb1-409f-9ddb-7ef8c671d0df None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:48:46.612533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae08fe-cbb1-409f-9ddb-7ef8c671d0df None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:48:46.616856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:48:46.617513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:48:46.617792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:48:46.618068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:48:46.629524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:48:46.631020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01cd63-7c19-4759-9396-599ab1e2f905 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:48:46.641420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 785/1539] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:28.666988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:28.667688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:28.667688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:28.688807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:28.690068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:28.703209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 755/1540] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:28.714336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:28.714947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:28.714947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:28.737498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:28.738713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:28.751050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 786/1541] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:28.756627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:28.767938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e798c-f437-4b40-8fc3-7956eb22e19c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:28.775744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:28.776442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:28.776818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:28.777088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:28.778058 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:28.778390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:28.780139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:28.794372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 756/1542] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:28.802726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:28.814526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b10f6-e375-47b4-ad80-2f80c5f301cd None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:28.821561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:28.822242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:28.822515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:28.822784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:28.823500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:28.825576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:28.863801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 787/1543] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:28 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:28.868467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:28.880917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7630e3-175c-482d-b1a5-6789fa67efdd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:28.968153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:28.968761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:28.969089 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:28.969410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:28.970241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:28.972717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.001578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 757/1544] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:28 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:29.005998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.020519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abedc-75bf-4ca9-be51-942132335ea9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.027975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.028795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.029073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.029340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.030077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.031827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.046875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 788/1545] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:29.050743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.062459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb516ef-3715-4e08-a947-5e033a4f9115 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.073945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.074807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.075140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.075411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.076468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.078495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf505-7744-47a9-b97b-d009cd02bf9f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.090995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 758/1546] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:29.096920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.112707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c82e-9077-4807-9a44-dcbeb9d1188c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.120200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.121271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.121552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.121857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] PATH_INFO: `/v3/projects/48a6269a634c4bafb35674a2127f49bf/users/ddec0bd4be6f44259ce3b396f89e158e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.141661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34266-b107-4181-8d4d-a4a421d913b2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.142027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34266-b107-4181-8d4d-a4a421d913b2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.142201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34266-b107-4181-8d4d-a4a421d913b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.165304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a6269a634c4bafb35674a2127f49bf, user_id=ddec0bd4be6f44259ce3b396f89e158e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.168865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6aaf1-b3e3-4228-b574-ca53391818e2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.170857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-47f34266-b107-4181-8d4d-a4a421d913b2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.175218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-47f34266-b107-4181-8d4d-a4a421d913b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.192781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 789/1547] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:29 2022] PUT /identity/v3/projects/48a6269a634c4bafb35674a2127f49bf/users/ddec0bd4be6f44259ce3b396f89e158e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:29.194267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187067-074b-4df5-ba87-10666fef7f0d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.194648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187067-074b-4df5-ba87-10666fef7f0d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.195130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187067-074b-4df5-ba87-10666fef7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.203128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 759/1548] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 14:50:29.217061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040fb4-16a3-4591-983b-cf49b84882d6 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.217434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040fb4-16a3-4591-983b-cf49b84882d6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.217623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040fb4-16a3-4591-983b-cf49b84882d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.224248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9f187067-074b-4df5-ba87-10666fef7f0d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.225593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9f187067-074b-4df5-ba87-10666fef7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.293157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-05040fb4-16a3-4591-983b-cf49b84882d6 None None] MFA Rules not processed for user `ddec0bd4be6f44259ce3b396f89e158e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.295032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-05040fb4-16a3-4591-983b-cf49b84882d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.312592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 790/1549] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.314366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368723-24a5-474e-980a-5be8ad586c3b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.314905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368723-24a5-474e-980a-5be8ad586c3b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.315405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368723-24a5-474e-980a-5be8ad586c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.346061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-00368723-24a5-474e-980a-5be8ad586c3b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.347854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-00368723-24a5-474e-980a-5be8ad586c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.359718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 791/1550] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.361832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a119-ffab-49d7-ae18-640e96723533 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.362296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a119-ffab-49d7-ae18-640e96723533 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.362726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a119-ffab-49d7-ae18-640e96723533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.383235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9d70a119-ffab-49d7-ae18-640e96723533 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.384470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9d70a119-ffab-49d7-ae18-640e96723533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.392494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 792/1551] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.393817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2594-1afb-42f6-824a-a16d005d5fb5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.394095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2594-1afb-42f6-824a-a16d005d5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.394363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2594-1afb-42f6-824a-a16d005d5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.404288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 760/1552] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:29.405768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.406060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.406331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.416318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4f2c2594-1afb-42f6-824a-a16d005d5fb5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.417665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4f2c2594-1afb-42f6-824a-a16d005d5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.426539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 793/1553] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.427772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ea0fc-ce6f-4e2b-8b90-bedc766834f3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.428056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ea0fc-ce6f-4e2b-8b90-bedc766834f3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.428326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ea0fc-ce6f-4e2b-8b90-bedc766834f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.433450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.434803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.444671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 761/1554] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.445607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.448015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7c4ea0fc-ce6f-4e2b-8b90-bedc766834f3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.449239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7c4ea0fc-ce6f-4e2b-8b90-bedc766834f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.455780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c2e2-3622-4bb2-9ebf-f76637b439bf None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.458077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 794/1555] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.459382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927c-e034-4d59-882c-4e5f12500e60 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.459820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927c-e034-4d59-882c-4e5f12500e60 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.460101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927c-e034-4d59-882c-4e5f12500e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.460614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.461278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.461556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.461892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.462647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.462956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.464622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d4ce9-70ef-43a7-988f-c0f2f3963436 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.477142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 762/1556] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.477977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-61c9927c-e034-4d59-882c-4e5f12500e60 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.478283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fe2c-0ea1-4500-aacd-c9d4689ec336 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.478567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fe2c-0ea1-4500-aacd-c9d4689ec336 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.478841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fe2c-0ea1-4500-aacd-c9d4689ec336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.479187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-61c9927c-e034-4d59-882c-4e5f12500e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.487425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 795/1557] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.488780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31dd63-9c99-4a76-b4cb-27ef5b56bd3f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.489140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31dd63-9c99-4a76-b4cb-27ef5b56bd3f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.489500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31dd63-9c99-4a76-b4cb-27ef5b56bd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.501315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f304fe2c-0ea1-4500-aacd-c9d4689ec336 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.502704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f304fe2c-0ea1-4500-aacd-c9d4689ec336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.507961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3d31dd63-9c99-4a76-b4cb-27ef5b56bd3f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.509116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3d31dd63-9c99-4a76-b4cb-27ef5b56bd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.510836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 763/1558] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.512207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845eed-1062-4c36-8fcb-b9dac3594fcc None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.512533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845eed-1062-4c36-8fcb-b9dac3594fcc None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.512870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845eed-1062-4c36-8fcb-b9dac3594fcc None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.514131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 764/1559] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:29.517726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 796/1560] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.519851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.520140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.520619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.522635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.522924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.523206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.539032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.540261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.541084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.542236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.548238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 765/1561] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.549065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.550190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 797/1562] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.550831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.560607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ba9da-74dd-416d-bf3c-48dcb340c7aa None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.561030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85375d-9883-458c-9ca2-f4de5096a6c1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.565112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.565490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.565763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.566042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.566147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.566331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.566439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.566678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.567032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.567333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.567451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.569024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226bef-7926-47f5-8781-74fddefe741b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.569927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8e49-6400-4dc8-bb2b-f73f8da19b43 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.580946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 766/1563] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.582380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef15ba4-fe61-438a-b0d7-3c68f6a64f50 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.582674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef15ba4-fe61-438a-b0d7-3c68f6a64f50 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.582955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef15ba4-fe61-438a-b0d7-3c68f6a64f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.601837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 798/1564] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:29.603410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.603625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.603931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.604722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cef15ba4-fe61-438a-b0d7-3c68f6a64f50 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.605986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cef15ba4-fe61-438a-b0d7-3c68f6a64f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.621650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.622853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.664382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 767/1565] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.665618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.665900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.666170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.684363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:29.685723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:29.691087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 799/1566] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.692048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.695157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 768/1567] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:29.696070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.705298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0434-d001-4e90-a84d-a3450d4357dd None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.705800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf366-6d81-41e1-9f71-e2e78aae3ddf None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.709687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.710330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.710470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.710607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.710878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.711060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.711335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.711598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.711745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.711939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.712356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.712652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.713546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.713810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:29.713810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:50:29.713810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:50:29.714677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.725401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 769/1568] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.732426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 800/1569] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.732590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.733166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.738227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364f5d3-7951-4e3f-a47c-867cb4b48d20 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.742754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041810-ed65-44a5-b2d6-f12e7c2faa9f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.743025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.743693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.743967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.744237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.744929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.746887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.748092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.748781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.749070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.749347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.750225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.750524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.752473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.770585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 770/1570] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.770585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.779595 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaedcb-0c4e-429d-a549-98ac57751cee admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.784204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 801/1571] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:29.784204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.836699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.837375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.837655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.837928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.838656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.840724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.844975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9b1c-27ea-40d6-90b8-e4332fa90664 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.849556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.850234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.850538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.850821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.851621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.851998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.853727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.865496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 771/1572] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:29.865496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.876451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 802/1573] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.876451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.880210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d15a0-e604-447d-aa34-a933b49d5e36 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.885139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.885828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.886106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.886379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.887098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:29.887408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.889098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.901591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 803/1574] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:29.902398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:29.913736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b0b-29a3-47c0-a7b6-ecdce436f4dd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.918567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.919296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.919582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.919886 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.920572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:29.922489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:29.936125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bf8d7-24f8-41b3-9e4a-b8ea1aae6f7a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:29.942336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:29.942985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:29.943268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:29.943537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:29.950752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 804/1575] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:29.950752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.000112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.001693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.011440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 772/1576] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:30.011813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d177-f388-4488-9200-46002d0d7be0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.012282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.017169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.017828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.018108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.018382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.019085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.021041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.023544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3816639-4984-467e-b8c7-0ee3eeac3f37 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.030036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.030923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.031860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.032140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.032837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.033983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:30.033983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:50:30.033983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:50:30.035584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.049862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 805/1577] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:29 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.049862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.070224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 773/1578] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.070224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.122108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960666-6368-4763-b046-24a50dfaf751 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.127415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.128269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.128414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.128649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.129343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.130390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:30.130390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:50:30.130390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:50:30.131622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.132819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc50-1c37-489c-8a80-8e4c40bc7fb6 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.137818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.138589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.138929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.139323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.140261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.141963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.153685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 806/1579] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.154503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.158630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 774/1580] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.159504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.164268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3b40d-9a36-46d5-b229-9ffc2353b4a0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.169211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9896-de42-4659-a0a1-3301a6ca7233 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.169497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.170146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.170434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.170826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.171548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.173504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.174169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.175024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.175467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.175941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.176756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.179050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.201297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 807/1581] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.202388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.209449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 775/1582] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.213118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.265722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057c80-c2b0-47d1-b2b7-3ed39c8fc2cb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.279599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48051226-a8c2-41a9-8f86-46e51c0997d4 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.286330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.287022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.287309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.287730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.288816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.292129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.318211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 776/1583] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.321658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.324015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.325220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.325530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.326690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.327966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.329729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462e321-0fb1-4f30-8bbb-625cfd78c57e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.330943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.335655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.336386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.336654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.336940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.337683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.339841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.353958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 808/1584] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.354904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.365983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 777/1585] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.365983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.366265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e219-e41b-44ba-8834-7332082582d2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.370631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.371325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.371605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.372018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.372905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.373623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6a77-3549-48c2-9be0-0642cff312f9 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.374537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.378323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.378972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.379252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.379533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.380332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.381933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.384917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 809/1586] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.385715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.392577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 778/1587] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.395423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad123404-b00b-481b-80f2-6d3eb0848ff6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.396179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.400430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.401089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.401370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.401641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.402323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.404356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb2ca1-2e0b-4a54-94b3-67c4851f218c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.406296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd14ff-363b-4221-87da-d3f268d0fa9d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.410957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.411604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.411949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.412221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.412933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.415551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.424277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 810/1588] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 301 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.425780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fece1-9cc6-4073-b16e-f72cdbcb9515 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.425920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fece1-9cc6-4073-b16e-f72cdbcb9515 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.426183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fece1-9cc6-4073-b16e-f72cdbcb9515 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.427504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 811/1589] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 14:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:30.428654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fece1-9cc6-4073-b16e-f72cdbcb9515 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.440977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 779/1590] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:30.440977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.441382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fece1-9cc6-4073-b16e-f72cdbcb9515 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.446048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.446718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.446996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.447265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.448027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.449690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.450319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433be8-f410-4076-b167-7214c1d58be2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.455111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.455792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.456072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.456346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.457063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.458667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.460561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 812/1591] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.461438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.471534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 780/1592] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.471534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.474036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da6cc-4793-4c47-837d-18d5b66c94ff admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.478948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.479652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.479986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.480282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.480987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.481343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483dd0-5894-4a83-b8d7-5328adb25c4b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.482812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.486113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.487032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.487312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.487584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] PATH_INFO: `/v3/projects/be010f31dec04a14af6c1a847055be84/users/c3854a6fd3aa40f6b91ff0827cb76bef/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.493820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 813/1593] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.494451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.503287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be010f31dec04a14af6c1a847055be84, user_id=c3854a6fd3aa40f6b91ff0827cb76bef, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.504490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:30.504490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:50:30.504490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:50:30.504801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9d55-161c-47e9-a8cc-a16ad1fd44da admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.506479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.510044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.510765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.511049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.511341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.512161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.513932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee81e1-aa3e-4fe2-9676-44b3135b331b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.522132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 781/1594] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:30 2022] PUT /identity/v3/projects/be010f31dec04a14af6c1a847055be84/users/c3854a6fd3aa40f6b91ff0827cb76bef/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:30.523408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.524466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 814/1595] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.526044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.526338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.526614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.545749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:30.546949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:30.590269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12e218-6312-43ed-ad43-45f6ec12472e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.595459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.596146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.596429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.596692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.597445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.599188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.609423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 782/1596] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.610310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.612752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 815/1597] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:30.613479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.620467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb24f-009b-46d3-a483-d9b25a20e984 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.624293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d02f5-9103-40ff-8d04-186185066be0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.625705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.626395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.626676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.626943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.627737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.629445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.629570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.630211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.630483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.630754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.631507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.633168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.640737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 783/1598] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.641774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.648967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 816/1599] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.650473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.658042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398cf-af50-4832-8aa6-e899e8eff503 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.664557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b1bdd-8779-49f0-a2ba-73fb0595f3dc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.666689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.667272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.667570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.667896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.668741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.670507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.671125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.672212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.672212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.673107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.674018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.676024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80875f25-0c8c-409b-b451-3d333e967c45 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.682170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 784/1600] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.682850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.688935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 817/1601] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.690848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.691338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.691946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.694382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a234f82-0e7e-4358-a69b-32ede8a74425 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.698990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.699974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.700242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.700552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] PATH_INFO: `/v3/projects/6e512012e71544cc9fa1a2853ee7cc51/users/a440a1183fca4565a84e009d99acf813/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.709631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:30.710827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:30.715460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e512012e71544cc9fa1a2853ee7cc51, user_id=a440a1183fca4565a84e009d99acf813, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.718242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.719236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 818/1602] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:30.720092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.729943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aadf0-b4bd-48c7-acda-94a1ec513890 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.736905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 785/1603] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:30 2022] PUT /identity/v3/projects/6e512012e71544cc9fa1a2853ee7cc51/users/a440a1183fca4565a84e009d99acf813/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:30.737737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.793693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9675-d042-414a-a8c3-bec7eb7177e5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.797341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.797741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.797991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.798268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.798418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.798525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.798684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.798955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.799711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.801314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.811431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 819/1604] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.812342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.821962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861bf-3121-4d12-9157-2cfdd7103df5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.827376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.828067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.828345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.828616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.829336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.830938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.841395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 820/1605] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:30.842501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.852780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6752-84c7-496c-97ef-c80700ff4c01 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.858259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.859164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.859581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.859892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] PATH_INFO: `/v3/projects/e0797ebc5e424833840c6317e344cb32/users/bb7d971490474c2092c1d13a24afa444/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.867269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.868801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.876164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0797ebc5e424833840c6317e344cb32, user_id=bb7d971490474c2092c1d13a24afa444, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.878844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.880552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 786/1606] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:30.881392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.893027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002fc3a-f5ee-4d55-822d-ab7343f6a40d service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.897592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 821/1607] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:30 2022] PUT /identity/v3/projects/e0797ebc5e424833840c6317e344cb32/users/bb7d971490474c2092c1d13a24afa444/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:30.908599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:30.960329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.961305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.961579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.961840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] PATH_INFO: `/v3/projects/b0daf03d413044a1921655eb34fb4703/users/95734a0c5b0d4a3babd3d5e70f42f15e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:30.979610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0daf03d413044a1921655eb34fb4703, user_id=95734a0c5b0d4a3babd3d5e70f42f15e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:30.982465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:30.987806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8e82-3550-4519-87be-2f26563f6b67 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:30.993469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:30.994648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:30.995136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:30.995602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] PATH_INFO: `/v3/projects/9b4c42db32484b47a7a01692da653e2f/users/01ef3958566645939bc64e09f4f64950/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.000954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 787/1608] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:30 2022] PUT /identity/v3/projects/b0daf03d413044a1921655eb34fb4703/users/95734a0c5b0d4a3babd3d5e70f42f15e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:31.001879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.016105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4c42db32484b47a7a01692da653e2f, user_id=01ef3958566645939bc64e09f4f64950, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.019204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76dff9-b944-4b6d-8b33-f301c2e83cf0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.035860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 822/1609] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:30 2022] PUT /identity/v3/projects/9b4c42db32484b47a7a01692da653e2f/users/01ef3958566645939bc64e09f4f64950/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:31.037397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.037607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.037856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.057191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.058376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.070036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bbf8-e285-46b7-a053-c87581f7dd8b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.125218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 823/1610] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.126517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.134685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.135710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.136137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.136570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.145119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a659fd-98f6-4104-9167-25c403d5bd80 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.147391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.149073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.150483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.151414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.151724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.152004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] PATH_INFO: `/v3/projects/13eeb032898e4c849a1199c303bbd3f4/users/d4d50f2112aa4717abad13699aef82da/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.161219 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 788/1611] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:31.162351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.177288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9b11-f65a-4448-b6e2-25c06099b6ca service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.179339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13eeb032898e4c849a1199c303bbd3f4, user_id=d4d50f2112aa4717abad13699aef82da, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.183180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.184466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.184876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.185273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20932768-67ed-424e-af5b-0797c628267e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.185482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] PATH_INFO: `/v3/projects/17dafc77bc7444f5888246fac0a1c999/users/f0fc4ec8d3884e679cf6fe690a191b8b/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.204871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 824/1612] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:31 2022] PUT /identity/v3/projects/13eeb032898e4c849a1199c303bbd3f4/users/d4d50f2112aa4717abad13699aef82da/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:31.206636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.206929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.207255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.216854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17dafc77bc7444f5888246fac0a1c999, user_id=f0fc4ec8d3884e679cf6fe690a191b8b, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.220165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1e72-6ea6-46d5-a104-bf4d9052e25c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.240574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 789/1613] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:31 2022] PUT /identity/v3/projects/17dafc77bc7444f5888246fac0a1c999/users/f0fc4ec8d3884e679cf6fe690a191b8b/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:31.242578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d96d5-6006-4b5f-9325-188360eddf16 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.243170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d96d5-6006-4b5f-9325-188360eddf16 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.243450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d96d5-6006-4b5f-9325-188360eddf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.245960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] MFA Rules not processed for user `bb7d971490474c2092c1d13a24afa444`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.247813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.264831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-114d96d5-6006-4b5f-9325-188360eddf16 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.266462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-114d96d5-6006-4b5f-9325-188360eddf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.352208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 790/1614] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.352208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad474078-d382-47ff-91f5-f9361d4f61ca None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.352208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad474078-d382-47ff-91f5-f9361d4f61ca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.352208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad474078-d382-47ff-91f5-f9361d4f61ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.365320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 825/1615] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.365320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.376755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ad474078-d382-47ff-91f5-f9361d4f61ca None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.378463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ad474078-d382-47ff-91f5-f9361d4f61ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.390431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 791/1616] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.392353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.392685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.393085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.427581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] MFA Rules not processed for user `d4d50f2112aa4717abad13699aef82da`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.429056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.453937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92565115-f7d5-4cd8-9389-1366d9a92da3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.459330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.460354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.460920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.461372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.475977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.478452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd4abe-50e7-4caf-bc2d-22cd6e647650 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.490680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 826/1617] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:31.492432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.493155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.493442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.514289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:31.515528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.532519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 827/1618] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.533907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.535659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:31.543130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 792/1619] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:31.544707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.552262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03527-4d53-48a3-a495-68b2f86ec55f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.558023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b44a-a498-4bc0-9a1a-f3bc1e8c5da6 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.560170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.561074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.561074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.561354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.570756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.572402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.572563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.572759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.573475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.575974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.585834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.587551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.613084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 828/1620] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:31.613932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.633820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d14-3ea4-4417-b849-c921f12822df service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.636911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 793/1621] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:31.638776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.643594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.644594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.645320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.645594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.669076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.671757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.690270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 829/1622] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:31.691330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.701359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d7e3-20e5-4d8f-9ed5-2ce0d82661ef service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.777102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b65d-6d12-4953-8530-a32087c22660 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:31.790608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.792787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.793497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.794880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.797655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.809378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.817926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:31.819683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:31.820568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:31.821648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:31.843095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:31.847704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:31.871412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 794/1623] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:31.871810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.874711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 830/1624] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:31.875842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:31.903927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c343b7b-72d9-4d5a-b793-2095b1ea6785 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.032050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd378e-8708-4873-a32f-00cdeba035fd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.037339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.037690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.037967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.038241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.039833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.041890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c485fc3-c28b-4e13-b5b5-3e9b4b7edb0b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.076355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.077263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 795/1625] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:32.078449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1400-3900-4399-a591-aba763d29ce6 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.080536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.080816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.081231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.082085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.084166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1400-3900-4399-a591-aba763d29ce6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.084749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.084963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1400-3900-4399-a591-aba763d29ce6 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.090329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 796/1626] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:50:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:32.092875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1400-3900-4399-a591-aba763d29ce6 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.112719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1400-3900-4399-a591-aba763d29ce6 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.119592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.120386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.120676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.120953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.122534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.125338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d30a8-b61f-448f-8331-f463d7060b38 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.139564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 797/1627] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:32.141244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.141617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.141814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.155593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 831/1628] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:31 2022] POST /identity/v3/users => generated 309 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:32.156435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.168565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:32.169767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4db79-c421-4c3e-9f56-47357b03beeb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.170096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:32.177489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.178997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.179413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.180006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] PATH_INFO: `/v3/projects/405a74587f214a758f63202c1a844539/users/27e583fc62004fc0a955130b180910b9/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.229121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405a74587f214a758f63202c1a844539, user_id=27e583fc62004fc0a955130b180910b9, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.233268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.263516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 832/1629] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:32 2022] PUT /identity/v3/projects/405a74587f214a758f63202c1a844539/users/27e583fc62004fc0a955130b180910b9/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:32.264366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.327013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 798/1630] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:32.328244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.352766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d9b60-cbfc-493e-b6c2-49034664b043 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.395119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bffbed-f144-40bb-9ff4-74b5a73f0d50 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.408386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.409263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.409979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.410348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.411600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.414050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75e00-c8bf-4b7b-b352-9a895f4d2a7b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.428051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 833/1631] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:32.431192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433643cb-43cf-44ea-99a0-5b83481e6106 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.431840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433643cb-43cf-44ea-99a0-5b83481e6106 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.432590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433643cb-43cf-44ea-99a0-5b83481e6106 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.438881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 834/1632] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 14:50:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:32.440127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433643cb-43cf-44ea-99a0-5b83481e6106 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.441982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.443724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.444293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.444797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.446389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.448759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02949d2-c487-4a44-b331-7654d3a3e82a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.464083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433643cb-43cf-44ea-99a0-5b83481e6106 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.471007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.472317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.472955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.473471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] PATH_INFO: `/v3/projects/2202f075de7b4a1d81661e24ede93ed9/users/57eb477c0de447249779b9f42eca3b7f/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.491295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 799/1633] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:32.493165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0e127-8a5a-4e51-bdbd-08c95a67fc43 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.493508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0e127-8a5a-4e51-bdbd-08c95a67fc43 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.493777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0e127-8a5a-4e51-bdbd-08c95a67fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.506460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2202f075de7b4a1d81661e24ede93ed9, user_id=57eb477c0de447249779b9f42eca3b7f, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.512040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.543782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 835/1634] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:32 2022] PUT /identity/v3/projects/2202f075de7b4a1d81661e24ede93ed9/users/57eb477c0de447249779b9f42eca3b7f/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:32.545610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.576881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-50d0e127-8a5a-4e51-bdbd-08c95a67fc43 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:32.578398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-50d0e127-8a5a-4e51-bdbd-08c95a67fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:32.672779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c035-0a53-4033-857e-8adda1693929 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.682931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.684816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.685250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.685759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] PATH_INFO: `/v3/projects/405a74587f214a758f63202c1a844539/users/27e583fc62004fc0a955130b180910b9/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.688864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=405a74587f214a758f63202c1a844539, user_id=27e583fc62004fc0a955130b180910b9, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.693414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.714901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 836/1635] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:32 2022] PUT /identity/v3/projects/405a74587f214a758f63202c1a844539/users/27e583fc62004fc0a955130b180910b9/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:32.715988 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.729994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 800/1636] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:32.731795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.732282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.732647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.791516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] MFA Rules not processed for user `c3854a6fd3aa40f6b91ff0827cb76bef`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:32.793073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:32.827936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b0f11-c0dd-4751-b916-4142ce14d67b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:32.835252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:32.836028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.836351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.836665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.837478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:32.840982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c01b-4995-421a-b003-96b6ef5d5d95 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:32.860457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 837/1637] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:32.862832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:32.863203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:32.863555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:32.887409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 801/1638] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:32.887409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:32.928971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] MFA Rules not processed for user `27e583fc62004fc0a955130b180910b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:32.931031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:32.998759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86528da5-3324-413b-a1f6-fc232fa0dd59 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:33.004492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:33.005492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.005863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.006227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.042167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 838/1639] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:33.042845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:33.054570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53effa1c-2138-40a2-8b71-796a4f6d2337 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:33.060745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:33.061652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.061917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.062706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] PATH_INFO: `/v3/projects/2202f075de7b4a1d81661e24ede93ed9/users/57eb477c0de447249779b9f42eca3b7f/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.065764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2202f075de7b4a1d81661e24ede93ed9, user_id=57eb477c0de447249779b9f42eca3b7f, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:33.069150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30552-6624-461e-8d0b-9efa10a19f19 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:33.082180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 839/1640] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:33 2022] PUT /identity/v3/projects/2202f075de7b4a1d81661e24ede93ed9/users/57eb477c0de447249779b9f42eca3b7f/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:33.083588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.084038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.084314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.105486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] MFA Rules not processed for user `c3854a6fd3aa40f6b91ff0827cb76bef`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:33.107491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:33.175969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 840/1641] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:33.175969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:33.196948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:33.199121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6796-3464-42a1-8fdf-118057f17cc1 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:33.215195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 802/1642] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:33.219239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.223935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.224204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.282869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] MFA Rules not processed for user `57eb477c0de447249779b9f42eca3b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:33.284138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:33.285678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38b448-90a3-495e-bb87-c4e84cdd8b41 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:33.301872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:33.304873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.305281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.306704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.456772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:33.459638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:33.486228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 803/1643] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:33.489241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 841/1644] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:33.490160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:33.679486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:33.679924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773859f8-3f6e-4f1e-b560-cc2ae6213c4a service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:33.699768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b30914-2231-40fc-988f-f0025646d16b None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:33.705284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:33.706009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.707438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.710534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.713562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:33.715409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:33.717232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:33.721813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:33.750862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:33.760619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:33.774329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:33.786952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:33.811776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 842/1645] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:33.836528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 804/1646] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:33.991216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:34.054034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:34.089390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d678-b7c9-4c23-b28a-1353b3544762 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:34.095913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:34.097438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.097850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.097976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.135366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f43efc-21e9-4380-910a-32cb0280631b service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:34.140424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:34.141563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.141941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.142345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] PATH_INFO: `/v3/users/ddec0bd4be6f44259ce3b396f89e158e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.144122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddec0bd4be6f44259ce3b396f89e158e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:34.146387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:34.175327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:34.177491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:34.193358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 805/1647] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:34.235565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:34.256526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f50f6-5911-4c66-be54-2e10d801eab8 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:34.262651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddec0bd4be6f44259ce3b396f89e158e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.269545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:34.271336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.271725 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.272440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] PATH_INFO: `/v3/users/d4d50f2112aa4717abad13699aef82da` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.276726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d50f2112aa4717abad13699aef82da)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:34.278409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: WARNING py.warnings [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:34.278409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: warnings.warn(msg) May 04 14:50:34.278409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: May 04 14:50:34.280182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddec0bd4be6f44259ce3b396f89e158e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.283454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:34.297054 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddec0bd4be6f44259ce3b396f89e158e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.346371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddec0bd4be6f44259ce3b396f89e158e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.349749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9768059e-356e-49ae-b960-dbf9878ec30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddec0bd4be6f44259ce3b396f89e158e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.369876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 843/1648] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:33 2022] DELETE /identity/v3/users/ddec0bd4be6f44259ce3b396f89e158e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:34.373204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.374967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.377000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.426491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:34.427860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:34.440959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d50f2112aa4717abad13699aef82da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.441779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d50f2112aa4717abad13699aef82da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.471511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d50f2112aa4717abad13699aef82da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.472340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d50f2112aa4717abad13699aef82da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.491812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6f1416fc-5d13-425f-95d5-bbb3a8b51047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d50f2112aa4717abad13699aef82da'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:34.544399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 806/1649] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:34 2022] DELETE /identity/v3/users/d4d50f2112aa4717abad13699aef82da => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:50:34.553908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.555107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.558458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.584880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 844/1650] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:34.592789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:34.595782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:34.600575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:34.602219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:34.769638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0cd39-872e-427b-83f0-dd5a9f486b7a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:34.790662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 807/1651] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:34.817198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:34.839622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:34.840781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.841064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.841467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.853534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:34.856931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4b738-5053-40ee-899d-d7d22f722f53 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:34.868672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 845/1652] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:34.899134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9de7-ac5b-4935-bb19-b28ebd4ab2f0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:34.903657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:34.904942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:34.905194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:34.905386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:34.918667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:34.920796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1dc45-8efd-4cad-b97b-75e2574e660a service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:34.935134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 808/1653] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:35.414042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:35.414521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:35.414613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:35.416311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 846/1654] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 14:50:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:35.430538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:35.430789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:35.431077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:35.498136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:35.501200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:35.541548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b531e9a-d594-4977-bb23-396bcbdc56d5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:35.544320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:35.545757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:35.551795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:35.553357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:35.553795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:35.554178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] PATH_INFO: `/v3/projects/48a6269a634c4bafb35674a2127f49bf` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:35.556236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a6269a634c4bafb35674a2127f49bf)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:35.557904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: WARNING py.warnings [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:50:35.557904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: warnings.warn(msg) May 04 14:50:35.557904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: May 04 14:50:35.559542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:35.574453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 809/1655] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:35.597063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:35.598859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:35.642016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119bba-72ce-4efe-9231-c3f189567fba None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:35.695468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a6269a634c4bafb35674a2127f49bf', 'request_id': 'req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.751039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a6269a634c4bafb35674a2127f49bf', 'request_id': 'req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.800612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a6269a634c4bafb35674a2127f49bf', 'request_id': 'req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.817707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:35.818783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:35.819067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:35.819753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] PATH_INFO: `/v3/projects/13eeb032898e4c849a1199c303bbd3f4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:35.821253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13eeb032898e4c849a1199c303bbd3f4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:35.829410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:35.840353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] The token cache is being invalidate because project 48a6269a634c4bafb35674a2127f49bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:35.845360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.848277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.859492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 847/1656] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:35 2022] DELETE /identity/v3/projects/48a6269a634c4bafb35674a2127f49bf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:35.859492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:35.863093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:35.954337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13eeb032898e4c849a1199c303bbd3f4', 'request_id': 'req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.967455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13eeb032898e4c849a1199c303bbd3f4', 'request_id': 'req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:35.994626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13eeb032898e4c849a1199c303bbd3f4', 'request_id': 'req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.021928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] The token cache is being invalidate because project 13eeb032898e4c849a1199c303bbd3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:36.025953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.028056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8ad1f9d9-8711-4a2f-bb13-7e449ee3bf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.035443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 810/1657] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:35 2022] DELETE /identity/v3/projects/13eeb032898e4c849a1199c303bbd3f4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:50:36.043029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.044745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.045852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.096189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:36.098605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887f2a1-95a8-4ff4-86c5-96ac73c090f9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.098968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:36.209562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.210728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.211011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.211286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.216845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:36.249141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.251775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bc500-45a8-4c9b-b8b7-67ec1bf78a3a service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.266496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 811/1658] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:36.270045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 848/1659] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:36.270357 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:36.272008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:36.275645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.275959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.276232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.303731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12a0a-570a-4f20-ac9b-9c92223ffdd2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.313631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:36.314985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:36.318050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.319350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.320074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.321262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] PATH_INFO: `/v3/users/57eb477c0de447249779b9f42eca3b7f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.325893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57eb477c0de447249779b9f42eca3b7f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.331491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.336100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 849/1660] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:36.340247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:36.357105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae896132-4a44-488a-b57e-c944fb1dda41 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.363647 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.364547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.364833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.365108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.366788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:36.367135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.370382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.390923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 850/1661] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:36.392726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:36.406826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df666-c629-4b9b-bcf0-525c3f770c2e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.418922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.419854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.420311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.420903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.421798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.424070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.450263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57eb477c0de447249779b9f42eca3b7f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.453679 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57eb477c0de447249779b9f42eca3b7f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.476016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 851/1662] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:36 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:36.476236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57eb477c0de447249779b9f42eca3b7f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.476236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57eb477c0de447249779b9f42eca3b7f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.477211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:36.481396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:36.496213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57eb477c0de447249779b9f42eca3b7f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:36.545120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 812/1663] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:36 2022] DELETE /identity/v3/users/57eb477c0de447249779b9f42eca3b7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:36.696952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c899-f984-4fbf-a1c0-b8695a308174 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.864225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.864939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.865270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.866993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.868331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.872248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.911378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 852/1664] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:36 2022] POST /identity/v3/users => generated 283 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:36.915655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:36.948323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5f9d-72d5-490d-bb29-c3bcbf37b33e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:36.955504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:36.968543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:36.969138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:36.969618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:36.970716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:36.972914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:36.992499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 813/1665] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:36.993365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:37.017420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294017d-1f34-4798-aee6-9929ca9763fc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:37.034022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:37.036121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.037620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.037916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.043857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:37.045629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db620-063d-4b71-9dd0-365c1fad5a9b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:37.075461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 853/1666] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:50:37.076794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:37.089763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccabe0d-8dfe-476b-a80d-4ad30e881e4f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:37.100649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:37.101843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.104116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.104624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] PATH_INFO: `/v3/projects/1057174eedf24a34a083ec7f72e9a3a3/users/b9c0ddfc8bf148c8a230908f0297f301/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.150536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1057174eedf24a34a083ec7f72e9a3a3, user_id=b9c0ddfc8bf148c8a230908f0297f301, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:37.154054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:37.192996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 814/1667] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:37 2022] PUT /identity/v3/projects/1057174eedf24a34a083ec7f72e9a3a3/users/b9c0ddfc8bf148c8a230908f0297f301/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:37.193212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073205ad-a2a6-4288-80e4-26a9a9327022 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.193439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073205ad-a2a6-4288-80e4-26a9a9327022 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.193673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073205ad-a2a6-4288-80e4-26a9a9327022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.230113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-073205ad-a2a6-4288-80e4-26a9a9327022 None None] MFA Rules not processed for user `b9c0ddfc8bf148c8a230908f0297f301`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:37.231640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-073205ad-a2a6-4288-80e4-26a9a9327022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:37.336715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 854/1668] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:37.360246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:37.362164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:37.495641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebddf6-6175-46e1-839f-666900af8658 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.496296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebddf6-6175-46e1-839f-666900af8658 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.498566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebddf6-6175-46e1-839f-666900af8658 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.511953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6ce36-3bd9-419a-8166-c98f0da779ab admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:37.512503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 855/1669] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 14:50:37 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:37.517819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ab09-d550-476b-a456-605486a67bec None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.518411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ab09-d550-476b-a456-605486a67bec None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.519312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ab09-d550-476b-a456-605486a67bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.528426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:37.529179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.529528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.529862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.545766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f784ab09-d550-476b-a456-605486a67bec None None] MFA Rules not processed for user `0ac72e2a7a2c40dea1cb3ebe1a2f3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:37.549952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:37.550467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f784ab09-d550-476b-a456-605486a67bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:37.551529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:37.574098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 815/1670] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:37.744400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 856/1671] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:37.751022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:37.769159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4370ca-c024-456e-ada9-7efdbcacd867 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:37.781574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:37.783351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:37.783846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:37.805346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:37.811465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:37.827511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:37.830253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ce803-bbe9-453c-95a3-b2e36a351190 service placement] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:37.846170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 816/1672] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:38.980962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ab09-d550-476b-a456-605486a67bec None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:38.982428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f784ab09-d550-476b-a456-605486a67bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:39.120234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ab09-d550-476b-a456-605486a67bec None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:39.128024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:39.129776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:39.130195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:39.130939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] PATH_INFO: `/v3/projects/2202f075de7b4a1d81661e24ede93ed9` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:39.134076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2202f075de7b4a1d81661e24ede93ed9)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:39.136589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:39.252736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2202f075de7b4a1d81661e24ede93ed9', 'request_id': 'req-24d5345a-6bd4-4581-990e-adb31bb7d5d2'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:39.266802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2202f075de7b4a1d81661e24ede93ed9', 'request_id': 'req-24d5345a-6bd4-4581-990e-adb31bb7d5d2'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:39.280348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2202f075de7b4a1d81661e24ede93ed9', 'request_id': 'req-24d5345a-6bd4-4581-990e-adb31bb7d5d2'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:39.303287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] The token cache is being invalidate because project 2202f075de7b4a1d81661e24ede93ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:39.304179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:39.307141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24d5345a-6bd4-4581-990e-adb31bb7d5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:39.315494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 857/1673] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:38 2022] DELETE /identity/v3/projects/2202f075de7b4a1d81661e24ede93ed9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:39.317383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:39.317941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:39.317941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:39.391792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:39.395347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:39.634311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:39.634759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 817/1674] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:39.635105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:39.635504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:39.677729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:39.679845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:39.712934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 858/1675] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:39.717167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:39.732472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d347-0812-4ef1-b101-4f6237421e35 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:39.753769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:39.756394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:39.758980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:39.759491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:39.762814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:39.763405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:39.765713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:39.786914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 818/1676] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:39.788010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:39.803398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f251d9-faa8-4a32-823c-a46db0466dad None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:39.814648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:39.815338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:39.815622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:39.827451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:39.828404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:39.830348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:39.919729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 859/1677] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:39 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:39.923792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:39.939145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45866b12-6576-44ea-a700-1c10725b9ca9 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:40.148547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:40.149251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:40.149853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:40.150111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:40.150816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:40.158082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:40.261235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:40.265897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 819/1678] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:39 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:40.276809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f543-0d6f-4ddf-857c-806d835637ca admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:40.295720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:40.296775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:40.296901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:40.297139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:40.298013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:40.299854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:40.354589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 860/1679] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:40.358505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:40.372166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bac-f6ae-44ab-80de-fbb6679f283c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:40.388606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:40.389288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:40.389573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:40.389846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:40.390582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:40.392245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbfb8d-b76d-4b7d-b7bb-4bcdaf781796 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:40.427376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 820/1680] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:40.431558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:40.450656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1edcc7-5c7b-473f-8c6d-086a0452ba72 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:40.473913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:40.475264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:40.475554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:40.475857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] PATH_INFO: `/v3/projects/6e9b9eb31d5e4dc088ea53f1be5adb1c/users/4e7bb28aa0624d30b990f60fe4c6307f/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:40.516323 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9b9eb31d5e4dc088ea53f1be5adb1c, user_id=4e7bb28aa0624d30b990f60fe4c6307f, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:40.519045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:40.563414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 861/1681] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:40 2022] PUT /identity/v3/projects/6e9b9eb31d5e4dc088ea53f1be5adb1c/users/4e7bb28aa0624d30b990f60fe4c6307f/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:40.573666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:40.573820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:40.574133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:40.653972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] MFA Rules not processed for user `4e7bb28aa0624d30b990f60fe4c6307f`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:40.655496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:40.797080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 821/1682] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:40.801774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.014533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e04b-3f2f-435d-9aa6-478e1bc405ac admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.028139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.029417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.029797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.030177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.031489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.034719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26519c07-a824-459b-a4e5-17a93b2b4083 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.081895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 862/1683] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:40 2022] POST /identity/v3/projects => generated 389 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:41.086374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.105110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cb62d-2e04-4890-bf77-56f0cee097df None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.190305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.190665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.191014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.260115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:41.264243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:41.344197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.345261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.345765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.346222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.347583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.353570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.413431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 822/1684] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:41 2022] POST /identity/v3/users => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:41.424702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.458207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d085-d72d-4bfe-ac65-fe63282fe529 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.474748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.475228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.475512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.475819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.476558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.481036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 863/1685] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:41.485877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.513056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.527927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 823/1686] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:41.532059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce51889-a542-403f-bfa1-9c2614e24c93 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.545133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.551035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.551395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.551698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] PATH_INFO: `/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd/users/e1804c05ed4f4dbca4103389c1d2e123/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.610334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5788d9ce7b4341a1bca8a9a51bdcbd, user_id=e1804c05ed4f4dbca4103389c1d2e123, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.620280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.659991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.660565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 864/1687] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:41 2022] PUT /identity/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd/users/e1804c05ed4f4dbca4103389c1d2e123/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:41.677007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5ff5-3e6a-4a13-a43e-18dab02900d1 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.834749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.836428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.837186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.837917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.839172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.841424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.853518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.855189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:41.882917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 824/1688] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:41.884588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:41.907642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591838c1-8b6f-4f68-ac87-03ccddac9b46 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:41.929423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:41.930349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:41.934417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:41.936234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] PATH_INFO: `/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd/users/e1804c05ed4f4dbca4103389c1d2e123/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:41.942476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5788d9ce7b4341a1bca8a9a51bdcbd, user_id=e1804c05ed4f4dbca4103389c1d2e123, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:41.953946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92790c8e-58c6-4fb0-84ca-829186b556fc admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:41.998446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 825/1689] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:41 2022] PUT /identity/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd/users/e1804c05ed4f4dbca4103389c1d2e123/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:42.017819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:42.020655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:42.020935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:42.107098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3895-ea3f-478b-a15a-5524b2d7c109 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:42.132709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] MFA Rules not processed for user `e1804c05ed4f4dbca4103389c1d2e123`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:42.134190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:42.259344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:42.260187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 826/1690] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:42.264254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:42.264782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:42.264863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:42.274406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:42.276873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:42.365760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60d63-8d5b-4e4f-8d65-6fb5b1a9e57a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:42.373922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:42.374815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:42.375261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:42.375687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:42.388377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:42.389995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:42.416492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 827/1691] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:42.433854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:42.446454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99d63-e30a-4d9d-b73f-0a11e3ccdd6f service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:42.503021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 865/1692] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:50:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:50:42.703599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:42.878062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552464-6f12-4f7f-8fa3-3a1b1875755b service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:42.897516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:42.918323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:42.918716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:42.918996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] PATH_INFO: `/v3/users/4e7bb28aa0624d30b990f60fe4c6307f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:42.920465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7bb28aa0624d30b990f60fe4c6307f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:42.922787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:43.032841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7bb28aa0624d30b990f60fe4c6307f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:43.033657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7bb28aa0624d30b990f60fe4c6307f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:43.056382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7bb28aa0624d30b990f60fe4c6307f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:43.060349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7bb28aa0624d30b990f60fe4c6307f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:43.075236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7bb28aa0624d30b990f60fe4c6307f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:43.160828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 828/1693] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:42 2022] DELETE /identity/v3/users/4e7bb28aa0624d30b990f60fe4c6307f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:43.165731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:43.166010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:43.166296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:43.223083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:43.226722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:43.593437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 866/1694] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:43.663703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:43.673363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:43.888717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ce726-61d4-479c-889e-9746a8dda462 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:43.915029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:43.915029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:43.925924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:43.925924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:43.993124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:43.999214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:44.066373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 829/1695] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:47.217362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:47.223376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:47.253255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8205a4d-3725-4bf2-816d-b4c8256ce896 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:47.269499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:47.272516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:47.273086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:47.274125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] PATH_INFO: `/v3/projects/6e9b9eb31d5e4dc088ea53f1be5adb1c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:47.276867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9b9eb31d5e4dc088ea53f1be5adb1c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:47.283063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:47.418052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9b9eb31d5e4dc088ea53f1be5adb1c', 'request_id': 'req-927f2eb6-beaa-4173-a67c-6ad09cc7304d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.449581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9b9eb31d5e4dc088ea53f1be5adb1c', 'request_id': 'req-927f2eb6-beaa-4173-a67c-6ad09cc7304d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.475887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9b9eb31d5e4dc088ea53f1be5adb1c', 'request_id': 'req-927f2eb6-beaa-4173-a67c-6ad09cc7304d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.497427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] The token cache is being invalidate because project 6e9b9eb31d5e4dc088ea53f1be5adb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:47.497951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.500173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-927f2eb6-beaa-4173-a67c-6ad09cc7304d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.505661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 867/1696] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:47 2022] DELETE /identity/v3/projects/6e9b9eb31d5e4dc088ea53f1be5adb1c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:47.509787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:47.524288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd668766-193d-4f5b-a741-8fd62fbac3a0 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:47.736015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:47.736826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:47.737105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:47.741718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] PATH_INFO: `/v3/users/e1804c05ed4f4dbca4103389c1d2e123` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:47.743333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1804c05ed4f4dbca4103389c1d2e123)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:47.745386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:47.866864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1804c05ed4f4dbca4103389c1d2e123'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.867575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1804c05ed4f4dbca4103389c1d2e123'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.890486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1804c05ed4f4dbca4103389c1d2e123'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.893283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1804c05ed4f4dbca4103389c1d2e123'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.909520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1804c05ed4f4dbca4103389c1d2e123'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:47.960055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 830/1697] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:47 2022] DELETE /identity/v3/users/e1804c05ed4f4dbca4103389c1d2e123 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:48.060041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:48.060826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:48.061610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:48.100583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:48.107003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:48.308733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 868/1698] 10.222.0.43 () {58 vars in 1015 bytes} [Wed May 4 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:48.432059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:48.438712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:48.485548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33edc-d1e0-44b3-9743-65a913dd7f56 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:48.499295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:48.500101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:48.506656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:48.513601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:48.568745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:48.571513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd07b72-3a56-413f-ae36-f66620150463 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:48.583922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 831/1699] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:49.573261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:49.574779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:49.753152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd74766-9caa-4d84-b746-52a221122a54 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:49.769011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:49.769928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:49.770210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:49.770488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] PATH_INFO: `/v3/users/b9c0ddfc8bf148c8a230908f0297f301` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:49.771789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c0ddfc8bf148c8a230908f0297f301)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:49.774008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:49.897208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c0ddfc8bf148c8a230908f0297f301'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:49.932667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c0ddfc8bf148c8a230908f0297f301'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:49.961066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c0ddfc8bf148c8a230908f0297f301'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:49.998900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c0ddfc8bf148c8a230908f0297f301'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.000545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c0ddfc8bf148c8a230908f0297f301'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.022529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 869/1700] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:50:49 2022] DELETE /identity/v3/users/b9c0ddfc8bf148c8a230908f0297f301 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:50.027798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:50.028314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:50.028314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:50.069505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:50.083793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:50.269968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:50.271779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:50.337463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 832/1701] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:50.440278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:50.441770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:50.522382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4320a-cccb-4dcd-b9a9-626a1ce0d645 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:50.530587 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:50.532043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:50.532495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:50.532910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] PATH_INFO: `/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:50.537944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5788d9ce7b4341a1bca8a9a51bdcbd)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:50.540625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:50.659695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d527542-d101-45b9-adc2-0aaaacf4a0b4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:50.695636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:50.701538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:50.702258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:50.702808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:50.737401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:50.742000 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359213-30b6-4ce6-880e-ea12e2ea94b0 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:50.750206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5788d9ce7b4341a1bca8a9a51bdcbd', 'request_id': 'req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.768993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5788d9ce7b4341a1bca8a9a51bdcbd', 'request_id': 'req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.778022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 833/1702] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:50.795929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5788d9ce7b4341a1bca8a9a51bdcbd', 'request_id': 'req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.810938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] The token cache is being invalidate because project cf5788d9ce7b4341a1bca8a9a51bdcbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:50.811531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.812429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-afdd56f7-59be-4fc9-b5c6-d08a72a0b8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:50.815176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 870/1703] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:50 2022] DELETE /identity/v3/projects/cf5788d9ce7b4341a1bca8a9a51bdcbd => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:50:50.819860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:50.820220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:50.820744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:50.868899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:50.870561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:51.042533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 834/1704] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:51.051401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.052261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.052918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.096131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:51.098215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:51.138647 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 871/1705] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:51.142858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.157907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91ead-dadc-4563-9aef-48128849a87a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.164620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.165620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.166125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.166582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.167519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:51.168223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.170495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.184889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 835/1706] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:51.189327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.199989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a77ea-e1c0-4f9c-8f38-6a53a926a6ef None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.216430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.217687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.218193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.218708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.220111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.222552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.283589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 872/1707] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:51 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:51.289563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.304252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c80db-8783-4e63-8a1e-52e6d1939697 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.533974 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.535626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.537225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.541335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.542374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.545043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.611658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 836/1708] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:51 2022] POST /identity/v3/users => generated 286 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:51.614583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.633013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ccc4-6488-4837-9eff-2f27535e4be8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.650992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.652328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.652983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.654485 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.656237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.659257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.692591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 873/1709] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:51.696499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.722573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f2325-15d2-4590-817b-bf77b7014296 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.743185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.743888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.744184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.754419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.756457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.761877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80c67c-aa9f-4081-9d38-1706932dcfba admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.819110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:51.826666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 837/1710] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:51.834041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be2a3-a82e-47bb-b50a-afc761e93516 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:51.852944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:51.854489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.854489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.854787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] PATH_INFO: `/v3/projects/1a60ab9905494180a28680c72dce6c7b/users/f36fc81da7944caf91f37aa4778c1081/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:51.894591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a60ab9905494180a28680c72dce6c7b, user_id=f36fc81da7944caf91f37aa4778c1081, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:51.897955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff781-0994-4c35-88f2-f0d6baf77be3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:51.935808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 874/1711] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:51 2022] PUT /identity/v3/projects/1a60ab9905494180a28680c72dce6c7b/users/f36fc81da7944caf91f37aa4778c1081/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:51.942175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:51.942469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:51.942789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:52.057663 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:52.059150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:52.136283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:52.136642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:52.137004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:52.235020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] MFA Rules not processed for user `a440a1183fca4565a84e009d99acf813`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:52.240237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:52.343363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 838/1712] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:52.380604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:52.382851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:52.541910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 875/1713] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:52.562765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:52.567031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:52.613929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5a581-ed10-4e2f-9ef8-864f03b09879 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:52.634659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:52.641648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:52.645201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:52.645755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:52.674361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:52.676263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:52.727556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 839/1714] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:52.952459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f247bc-2169-47ab-a57a-68b6d841956e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:52.977963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:52.979919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:52.983748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:52.984426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:53.009223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:53.011730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1b086-1405-4c8f-b80a-0686e36efc00 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:53.035897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 876/1715] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:53.888947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:53.893068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:53.910547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb75b1-de93-41d3-b91c-20f734df9690 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:53.916416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:53.917707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:53.918286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:53.918927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] PATH_INFO: `/v3/projects/1057174eedf24a34a083ec7f72e9a3a3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:53.920511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1057174eedf24a34a083ec7f72e9a3a3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:53.922871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:54.002942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a79a-322c-4d6c-8680-f47d0964d0a7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.004226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a79a-322c-4d6c-8680-f47d0964d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.004696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a79a-322c-4d6c-8680-f47d0964d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.013571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1057174eedf24a34a083ec7f72e9a3a3', 'request_id': 'req-62341c1f-ff25-431f-b851-99a2b3fff9cb'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:54.029895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1057174eedf24a34a083ec7f72e9a3a3', 'request_id': 'req-62341c1f-ff25-431f-b851-99a2b3fff9cb'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:54.059443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1057174eedf24a34a083ec7f72e9a3a3', 'request_id': 'req-62341c1f-ff25-431f-b851-99a2b3fff9cb'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:54.126085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-08d3a79a-322c-4d6c-8680-f47d0964d0a7 None None] MFA Rules not processed for user `01ef3958566645939bc64e09f4f64950`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:54.130904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] The token cache is being invalidate because project 1057174eedf24a34a083ec7f72e9a3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:50:54.131800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-08d3a79a-322c-4d6c-8680-f47d0964d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:54.133534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:54.136203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-62341c1f-ff25-431f-b851-99a2b3fff9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:50:54.139535 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 840/1716] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:50:53 2022] DELETE /identity/v3/projects/1057174eedf24a34a083ec7f72e9a3a3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:54.150020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8daf9-1e32-4bc4-b981-fc75cd2fd92b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.150290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8daf9-1e32-4bc4-b981-fc75cd2fd92b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.150452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8daf9-1e32-4bc4-b981-fc75cd2fd92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.238900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-87b8daf9-1e32-4bc4-b981-fc75cd2fd92b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:54.243868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-87b8daf9-1e32-4bc4-b981-fc75cd2fd92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:54.398854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 877/1717] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:54.410679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.410903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.411476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.453304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 841/1718] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:54.455551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] MFA Rules not processed for user `01ef3958566645939bc64e09f4f64950`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:54.456937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:54.460839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd666-68a8-4835-ab12-c0eeabe3d521 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.461123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd666-68a8-4835-ab12-c0eeabe3d521 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.461571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd666-68a8-4835-ab12-c0eeabe3d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.481146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 878/1719] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:54.492399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:54.494197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:54.516794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ac1dd666-68a8-4835-ab12-c0eeabe3d521 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:54.519876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ac1dd666-68a8-4835-ab12-c0eeabe3d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:54.608709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 842/1720] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:50:54.615405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2f4-d5a3-4517-a176-1be3ef2176fd None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.616243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2f4-d5a3-4517-a176-1be3ef2176fd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.626171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2f4-d5a3-4517-a176-1be3ef2176fd None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.671434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 843/1721] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:50:54 2022] GET /identity => generated 270 bytes in 62 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:54.672875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a2f4-d5a3-4517-a176-1be3ef2176fd None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:54.733157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a2f4-d5a3-4517-a176-1be3ef2176fd None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:54.752774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:54.755928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.760023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.760948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.762841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:50:54.765096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:54.773430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:54.852276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 844/1722] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:50:54.853707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:54.895372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe4a4-040b-4e01-bf93-5c3eceab1d4a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:54.913218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669312b5-0058-40b6-9ffc-855597ff75d1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:54.924482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:54.926034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.926912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.927700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.929237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:54.932172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:54.947828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:54.948841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:54.951500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:54.952269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:54.992697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:54.994451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:55.040042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 879/1723] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:55.044828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 845/1724] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:54 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:55.049168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:55.086183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce7053-5a48-49dd-927f-441fab74a024 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:55.240385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:55.241533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.241983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.242415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.243366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:55.245835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:55.319003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 880/1725] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:55 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:55.328439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:55.361082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9651-4bd2-46fa-8c85-04b4e7abbc0d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:55.377581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:55.378711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.379171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.379749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.380900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:55.383192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a6cca-2085-4de6-bf4a-10d2ccd11e85 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:55.397044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 846/1726] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:55.401479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:55.421639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.423301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.423582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.424518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b221e5-afc5-4b03-983f-31cc571b5ead admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:55.439004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:55.441348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.445402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.445906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.449056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:55.456509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:55.514143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:55.515401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:55.518358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 881/1727] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:55.519437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:55.546232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789fd23-d7a2-42ad-bac3-0c44f841d909 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:55.574333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:55.575262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.575545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.575866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] PATH_INFO: `/v3/projects/cc52747cc34144f5a83a0bdc039b88ea/users/7d7f60f348d940d2939d3b318f35f879/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.625581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc52747cc34144f5a83a0bdc039b88ea, user_id=7d7f60f348d940d2939d3b318f35f879, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:55.628446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225141a-df6a-49b1-9817-22afc4d1114e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:55.662355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 882/1728] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:55 2022] PUT /identity/v3/projects/cc52747cc34144f5a83a0bdc039b88ea/users/7d7f60f348d940d2939d3b318f35f879/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:55.674401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:55.675049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:55.675489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:55.710858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 847/1729] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:55.724243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] MFA Rules not processed for user `7d7f60f348d940d2939d3b318f35f879`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:55.725841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:55.925105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 883/1730] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:55.932444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:55.949971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d0659-c0ce-4147-b8bb-212220b54ee1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.110701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.111491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.115159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.120844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.123431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.131897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.222961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 848/1731] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:55 2022] POST /identity/v3/projects => generated 369 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:56.227532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.242450 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eca2e-2a53-4033-8d8c-c3d625dd878e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.376711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.377645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.379435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.380638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.382917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.386235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.432651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 884/1732] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:56 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:56.436335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.450399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da6a0-514f-47d3-9088-e240b3e47780 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.456319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.457218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.457611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.458153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.459009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.460831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.474950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 849/1733] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:56.478804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.490878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da236-1b3d-4a97-ad47-c2b1166b0a97 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.505554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.506806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.509198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.509761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] PATH_INFO: `/v3/projects/43304ec79ee84003bc86d7ccd6a35d33/users/945ce36687064af4bffbabd5f0c918c7/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.551641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43304ec79ee84003bc86d7ccd6a35d33, user_id=945ce36687064af4bffbabd5f0c918c7, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.560758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.588656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 885/1734] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:56 2022] PUT /identity/v3/projects/43304ec79ee84003bc86d7ccd6a35d33/users/945ce36687064af4bffbabd5f0c918c7/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:56.592541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.603536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60fe48-a5bf-475c-a86d-1fb3626abd17 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.735289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.736070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.736347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.737011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.737758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.741967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437c110-263c-4dd6-95cd-b98b4e475746 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.770314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 850/1735] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:56.771585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.794496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2d45-e621-4b92-b119-2877d2361343 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:56.810592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:56.811791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.812208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.816238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] PATH_INFO: `/v3/projects/43304ec79ee84003bc86d7ccd6a35d33/users/945ce36687064af4bffbabd5f0c918c7/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.818619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43304ec79ee84003bc86d7ccd6a35d33, user_id=945ce36687064af4bffbabd5f0c918c7, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:56.821543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:56.863242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 886/1736] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:56 2022] PUT /identity/v3/projects/43304ec79ee84003bc86d7ccd6a35d33/users/945ce36687064af4bffbabd5f0c918c7/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:56.873644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:56.874267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:56.874610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:56.913709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:56.915963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:56.964026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] MFA Rules not processed for user `945ce36687064af4bffbabd5f0c918c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:56.987873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:57.227808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd53b0-d908-4372-ad4e-5cd4058d0fd9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:57.247531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:57.248539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.248999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.251103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.279091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 851/1737] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:57.292833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:57.294212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:57.294777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:57.297895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:57.344047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 887/1738] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:57.433812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2acfd9-35bd-4fb5-97af-97c6e7279745 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:57.441818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:57.444679 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.445040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.445384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.469844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:57.472052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ec559-0ed7-4fd2-afb6-7090ba956133 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:57.494251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 852/1739] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:57.598345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:57.599476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:57.619793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5918fba-95f4-48ec-8104-128cef326153 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:57.622986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.623271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.623547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.626758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:57.627435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.627899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.628173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.684051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] MFA Rules not processed for user `f36fc81da7944caf91f37aa4778c1081`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:57.685748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:57.711717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:57.713242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c608b-6b46-480c-9a20-a8a3676a5f36 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:57.732108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 888/1740] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:57.758336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961ea4-ae11-4585-9198-277da8f8d73e None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.758336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961ea4-ae11-4585-9198-277da8f8d73e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.760649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961ea4-ae11-4585-9198-277da8f8d73e None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.762244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 889/1741] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 14:50:57 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:50:57.773731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:57.774045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:57.774332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:57.830104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:57.833883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:57.836867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 853/1742] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:57.841028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:57.842598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:58.013587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645022-9a9b-4d27-b7f3-15b3212bbaaf None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.022486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 890/1743] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:58.027605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.028882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.028882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.028882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.029654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.032739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.091554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.092987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:58.095040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 854/1744] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:50:57 2022] POST /identity/v3/projects => generated 371 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:50:58.099244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.124545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398733-86c7-4244-98e1-7375c3a0c3f3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.256823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162c318-03d9-4688-b9b0-78d2671f7f49 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.280439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.282792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.283077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.283267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.283865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.284045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.284119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.284251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.284526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.291569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.295525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.297036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.337842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 891/1745] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:50:58.360221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 855/1746] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:50:58 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:50:58.360621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.387498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a0a3-2174-47a4-9680-48eb8ae2c5e3 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.406195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.406885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.407702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.407702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.408711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.410172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.439593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 892/1747] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:58.444281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.464336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3bea5-ba1c-446f-a6d3-53022ce222de admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.472754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.475855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.475855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.475855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] PATH_INFO: `/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f/users/fe6e7197eb314f32ae3d04171b759636/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.501073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd90d8fc59ed457fbdf2e070e1d76f0f, user_id=fe6e7197eb314f32ae3d04171b759636, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.506380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.530688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 856/1748] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:58 2022] PUT /identity/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f/users/fe6e7197eb314f32ae3d04171b759636/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:58.534786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.549407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2dad8-1a53-4429-a01f-2d4bd39381a6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.676235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.684429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.684939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.685298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.686121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.687973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44176-44b6-49fe-81d4-deeed9cc7afb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.701099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 893/1749] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:50:58.705977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:58.722160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ece93-26f3-4388-8fd7-17ef63dc4cdb admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:58.729273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:58.730372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.730906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.731195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] PATH_INFO: `/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f/users/fe6e7197eb314f32ae3d04171b759636/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:58.733888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd90d8fc59ed457fbdf2e070e1d76f0f, user_id=fe6e7197eb314f32ae3d04171b759636, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:58.736814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:58.749544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 857/1750] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:50:58 2022] PUT /identity/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f/users/fe6e7197eb314f32ae3d04171b759636/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:50:58.949175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d039-b340-45f9-8530-f04fd521074a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:58.949929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d039-b340-45f9-8530-f04fd521074a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:58.950211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d039-b340-45f9-8530-f04fd521074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:59.051417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fb55d039-b340-45f9-8530-f04fd521074a None None] MFA Rules not processed for user `f0fc4ec8d3884e679cf6fe690a191b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:59.053708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fb55d039-b340-45f9-8530-f04fd521074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:59.240452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 894/1751] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:59.247876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:59.272603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:59.272890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:59.273170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:59.328344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] MFA Rules not processed for user `95734a0c5b0d4a3babd3d5e70f42f15e`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:50:59.334297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:50:59.419901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9fa4-2012-42e8-bd0d-0bfc85754a91 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:59.438959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:59.443136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:59.445299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:59.445743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:59.476661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:59.483449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128c4e-a3b1-4316-9db7-e06f9e204a62 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:59.515132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 895/1752] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:50:59.530083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 858/1753] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:50:59.603436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:50:59.637729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82584063-724d-4861-ac70-a25b25e64c8c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:50:59.669195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:50:59.682369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:50:59.688401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:50:59.689070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:50:59.719274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:50:59.724861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:50:59.757575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 896/1754] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:00.505874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e136-2e1e-4938-8033-d635ca6e2ad0 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:00.506915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e136-2e1e-4938-8033-d635ca6e2ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:00.507435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e136-2e1e-4938-8033-d635ca6e2ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:00.562348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-7128e136-2e1e-4938-8033-d635ca6e2ad0 None None] MFA Rules not processed for user `01ef3958566645939bc64e09f4f64950`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:00.567432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7128e136-2e1e-4938-8033-d635ca6e2ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:00.678339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 859/1755] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:02.803199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:02.961271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8852f-54b6-4358-8ae9-b307f309e7fc None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:02.961955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8852f-54b6-4358-8ae9-b307f309e7fc None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:02.962343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8852f-54b6-4358-8ae9-b307f309e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.028485 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e4485-1f57-409b-a29e-06b236c70de1 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:03.032748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ece8852f-54b6-4358-8ae9-b307f309e7fc None None] MFA Rules not processed for user `a440a1183fca4565a84e009d99acf813`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:03.041208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:03.044752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:03.045380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:03.045930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] PATH_INFO: `/v3/users/7d7f60f348d940d2939d3b318f35f879` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.049946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ece8852f-54b6-4358-8ae9-b307f309e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:03.051252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7f60f348d940d2939d3b318f35f879)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:03.058178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:03.202290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 860/1756] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:03.226212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7f60f348d940d2939d3b318f35f879'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:03.244833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7f60f348d940d2939d3b318f35f879'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:03.268913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7f60f348d940d2939d3b318f35f879'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:03.291656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7f60f348d940d2939d3b318f35f879'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:03.292531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6781db0c-e11e-4cac-a3b2-2be4742f4674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7f60f348d940d2939d3b318f35f879'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:03.307969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 897/1757] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:02 2022] DELETE /identity/v3/users/7d7f60f348d940d2939d3b318f35f879 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:03.312623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:03.312905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:03.313256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.365969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57914c3-63cd-4b47-b04d-5ad255e33437 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:03.366306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57914c3-63cd-4b47-b04d-5ad255e33437 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:03.367925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57914c3-63cd-4b47-b04d-5ad255e33437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.412153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:03.416804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:03.469499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d57914c3-63cd-4b47-b04d-5ad255e33437 None None] MFA Rules not processed for user `fe6e7197eb314f32ae3d04171b759636`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:03.476961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d57914c3-63cd-4b47-b04d-5ad255e33437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:03.582261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 861/1758] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:03.637912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:03.639696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:03.698238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 898/1759] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:03.711275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531d9-0469-47e6-8039-bdee8517ed30 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:03.711694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531d9-0469-47e6-8039-bdee8517ed30 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:03.712197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531d9-0469-47e6-8039-bdee8517ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.749540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-dab531d9-0469-47e6-8039-bdee8517ed30 None None] MFA Rules not processed for user `f36fc81da7944caf91f37aa4778c1081`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:03.754841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-dab531d9-0469-47e6-8039-bdee8517ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:03.814644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e93d-0ea5-403d-bae6-362716a9a5e4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:03.827959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:03.830566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:03.830861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:03.832275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:03.855908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:03.860780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:03.901802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 862/1760] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:03.903635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 899/1761] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:03.973870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:03.976218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:04.177159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c2f7-2c00-4e3a-953f-2253e36f0b98 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:04.184526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:04.185350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:04.185948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:04.186492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:04.188745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:04.202837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:04.204785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce2af0-bda5-4350-ab05-c72a8982d3ca service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:04.220569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 863/1762] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:06.153884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:06.154800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:06.155259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:06.190929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] MFA Rules not processed for user `95734a0c5b0d4a3babd3d5e70f42f15e`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:06.192596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:06.389858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 900/1763] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:06.704431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:06.704915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:06.705066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:06.738188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] MFA Rules not processed for user `f0fc4ec8d3884e679cf6fe690a191b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:06.739886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:06.899072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 864/1764] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:07.736957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:07.739545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:07.765628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0726a-5a32-4e03-b43d-897f494ac959 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:07.779588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:07.780523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:07.780803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:07.781084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] PATH_INFO: `/v3/projects/cc52747cc34144f5a83a0bdc039b88ea` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:07.782422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc52747cc34144f5a83a0bdc039b88ea)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:07.784491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:07.897183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc52747cc34144f5a83a0bdc039b88ea', 'request_id': 'req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:07.921385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc52747cc34144f5a83a0bdc039b88ea', 'request_id': 'req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:07.935638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc52747cc34144f5a83a0bdc039b88ea', 'request_id': 'req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:07.979409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] The token cache is being invalidate because project cc52747cc34144f5a83a0bdc039b88ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:07.981397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:07.983398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:07.990114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 901/1765] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:07 2022] DELETE /identity/v3/projects/cc52747cc34144f5a83a0bdc039b88ea => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:07.994033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:08.012681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07f89-852e-426b-b89a-212b535acd74 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:08.162388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:08.163849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:08.164966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:08.165259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] PATH_INFO: `/v3/users/945ce36687064af4bffbabd5f0c918c7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:08.168989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=945ce36687064af4bffbabd5f0c918c7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:08.173256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:08.340318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945ce36687064af4bffbabd5f0c918c7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:08.341839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945ce36687064af4bffbabd5f0c918c7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:08.369377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945ce36687064af4bffbabd5f0c918c7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:08.373272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945ce36687064af4bffbabd5f0c918c7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:08.396372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-04f7442f-cc75-48fb-b208-715263fd6d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945ce36687064af4bffbabd5f0c918c7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:08.443891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 865/1766] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:07 2022] DELETE /identity/v3/users/945ce36687064af4bffbabd5f0c918c7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:10.067480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:10.069811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:10.098144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e882ac-e0e3-4fc5-bec7-de2e55b21fb5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:10.269921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:10.271895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.272598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.273270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] PATH_INFO: `/v3/projects/43304ec79ee84003bc86d7ccd6a35d33` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.276087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43304ec79ee84003bc86d7ccd6a35d33)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:10.281443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:10.404690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43304ec79ee84003bc86d7ccd6a35d33', 'request_id': 'req-278d2949-3a88-4d7a-af10-43d94dfa74b4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:10.418060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43304ec79ee84003bc86d7ccd6a35d33', 'request_id': 'req-278d2949-3a88-4d7a-af10-43d94dfa74b4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:10.443757 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43304ec79ee84003bc86d7ccd6a35d33', 'request_id': 'req-278d2949-3a88-4d7a-af10-43d94dfa74b4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:10.476102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] The token cache is being invalidate because project 43304ec79ee84003bc86d7ccd6a35d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:10.477087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:10.478317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-278d2949-3a88-4d7a-af10-43d94dfa74b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:10.483723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 902/1767] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:10 2022] DELETE /identity/v3/projects/43304ec79ee84003bc86d7ccd6a35d33 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:10.490293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e4a0-4ed8-4644-aac2-e77c6a574a2e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.491074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e4a0-4ed8-4644-aac2-e77c6a574a2e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.491074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e4a0-4ed8-4644-aac2-e77c6a574a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.522227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8bf2e4a0-4ed8-4644-aac2-e77c6a574a2e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:10.525041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8bf2e4a0-4ed8-4644-aac2-e77c6a574a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:10.604754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355d3b-fba3-4083-91fd-a179972eae53 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.605124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355d3b-fba3-4083-91fd-a179972eae53 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.605591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355d3b-fba3-4083-91fd-a179972eae53 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.607039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 903/1768] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:51:10.647494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.647815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.648099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.710740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:10.715854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:10.720037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 866/1769] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:10.729169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.730320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.731356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.789000 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:10.793255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:10.836629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 867/1770] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:10.842475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:10.868269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbacb3-37a4-4542-8326-0b0c9205b182 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:10.885729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:10.889008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.889649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.890164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.891033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:10.893139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:10.897961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:10.944128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 904/1771] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:10.952175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 868/1772] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:10.957188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:10.969722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7b1d3-9d08-44ad-9464-5747b00c9ac3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:10.975489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:10.976242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:10.976529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:10.976806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:10.977578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:10.979618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.013913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 905/1773] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:10 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:11.017982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.032184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48706-3d1f-4655-97f6-300f8eb785c7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.131905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.132853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.133356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.133731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.134525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.136761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.175723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 869/1774] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:11 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:11.178395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.192855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077ab7-50c8-4e64-8132-b7a9dc3b4edb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.199520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.200888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.201131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.201492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.202320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.204268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.218569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 906/1775] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:11.222668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.234020 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0bec9-522c-4c96-b03f-b56a024eea00 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.244768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.245834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.246305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.246665 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.247588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.249698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.268402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 870/1776] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:11.269834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.283022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb47f-5d2d-4a2f-a35d-2c9b93106291 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.287921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.288938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.289313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.289688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] PATH_INFO: `/v3/projects/433efb63a3524793bda4313ab3834790/users/50f37780346f4ef9a1cc226d09d9666c/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.305382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433efb63a3524793bda4313ab3834790, user_id=50f37780346f4ef9a1cc226d09d9666c, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.308278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0e918-12a9-4293-a96f-0d292fbf8cf2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.324277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.326502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:11.346959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 907/1777] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:11 2022] PUT /identity/v3/projects/433efb63a3524793bda4313ab3834790/users/50f37780346f4ef9a1cc226d09d9666c/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:11.349133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.349425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.349764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.378898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] MFA Rules not processed for user `50f37780346f4ef9a1cc226d09d9666c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:11.380629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:11.418094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987ae2c-ae8e-440e-8afc-06aa935fda50 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.463788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 908/1778] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:11.468825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.506138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.506961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.507322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.507800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.518924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.520890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.535059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 871/1779] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:11.565760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af28f33-e21c-4145-b3e2-d64e05fbf348 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.572930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.573618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.574223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.574803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.575413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.580250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.613242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 909/1780] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:11 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:11.614478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.627215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee1d23-cdaa-4e59-ae8e-99e6dbe18a18 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.697675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.698382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.698694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.698978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.699748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.701718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.725860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 872/1781] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:11 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:11.728291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.739685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc13d-2dc1-4947-b753-7e236a6b126a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.745360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.746262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.746619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.746918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.747625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.749412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.763732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 910/1782] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:11.770478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.781970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486e29a-b067-453b-8ff7-f54afc9c69de admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:11.787970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:11.788912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:11.789342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:11.789899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] PATH_INFO: `/v3/projects/85dee3894a6346dc98770428a3bc54d8/users/34cd0c1a33ed4af0961668969f55c704/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:11.963383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dee3894a6346dc98770428a3bc54d8, user_id=34cd0c1a33ed4af0961668969f55c704, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:11.966487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:11.981633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 873/1783] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:11 2022] PUT /identity/v3/projects/85dee3894a6346dc98770428a3bc54d8/users/34cd0c1a33ed4af0961668969f55c704/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:11.985632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:11.996499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628aaa7-bd69-4e5f-adc3-1fa2077244f2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:12.062277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:12.063041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:12.063404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:12.063771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:12.064584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:12.066262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3935e-1105-4148-8339-bbf59de7339e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:12.078443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 911/1784] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:12.082483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:12.094081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504529-e240-4f89-abab-a071b6a72575 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:12.099141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:12.100328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:12.100603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:12.100870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] PATH_INFO: `/v3/projects/85dee3894a6346dc98770428a3bc54d8/users/34cd0c1a33ed4af0961668969f55c704/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:12.103087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dee3894a6346dc98770428a3bc54d8, user_id=34cd0c1a33ed4af0961668969f55c704, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:12.105986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:12.118075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 874/1785] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:12 2022] PUT /identity/v3/projects/85dee3894a6346dc98770428a3bc54d8/users/34cd0c1a33ed4af0961668969f55c704/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:12.128510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:12.128802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:12.129109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:12.161030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] MFA Rules not processed for user `34cd0c1a33ed4af0961668969f55c704`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:12.162466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:12.295362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 912/1786] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:12.331473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:12.339543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:12.557060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8ec9a-2b9c-4cfa-9c62-8f4139ef2eaf admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:12.562917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:12.564275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:12.564763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:12.565251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:12.577658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:12.579422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:12.612477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 875/1787] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:13.188061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:13.198335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966973d-a9a1-4ce9-b4d5-4189e6fb0b0c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:13.204814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34cd0c1a33ed4af0961668969f55c704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85dee3894a6346dc98770428a3bc54d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:13.205475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:13.205787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:13.206057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:13.206979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:13.207289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:13.209005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:13.224808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 913/1788] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:13.226315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:13.241418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578c802-f5b1-4463-a011-ad6c6f39582e service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:13.257802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34cd0c1a33ed4af0961668969f55c704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85dee3894a6346dc98770428a3bc54d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:13.259022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:13.259530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:13.260809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:13.262775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:13.265221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:13.302174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 876/1789] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:13 2022] POST /identity/v3/projects => generated 354 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:13.307367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:13.319784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81544f-c7d4-4271-90d3-36a1affa19e9 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:13.411636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34cd0c1a33ed4af0961668969f55c704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85dee3894a6346dc98770428a3bc54d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:13.412598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:13.412943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:13.413280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:13.414113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:13.414479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:13.416365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:13.430519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 914/1790] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:13.478450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:13.489951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e46c-7bb3-41e0-bfcf-ad0110d0f7fb tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:13.495286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34cd0c1a33ed4af0961668969f55c704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85dee3894a6346dc98770428a3bc54d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:13.496892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:13.497737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:13.498036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] PATH_INFO: `/v3/projects/63c431a48f5e4ba8954e357a6e30b559` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:13.499402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=63c431a48f5e4ba8954e357a6e30b559)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:13.501580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:13.554586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c431a48f5e4ba8954e357a6e30b559', 'request_id': 'req-e77c01bc-63e0-4e74-b57b-16395d6a8a10'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:13.562537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c431a48f5e4ba8954e357a6e30b559', 'request_id': 'req-e77c01bc-63e0-4e74-b57b-16395d6a8a10'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:13.571428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c431a48f5e4ba8954e357a6e30b559', 'request_id': 'req-e77c01bc-63e0-4e74-b57b-16395d6a8a10'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:13.583242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] The token cache is being invalidate because project 63c431a48f5e4ba8954e357a6e30b559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:13.583711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:13.584309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e77c01bc-63e0-4e74-b57b-16395d6a8a10 tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:13.586311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 877/1791] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:13 2022] DELETE /identity/v3/projects/63c431a48f5e4ba8954e357a6e30b559 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:13.971723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:13.974180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:14.137073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4cc9-524a-4082-98b9-1b0bee5ca68c tempest-VolumeQuotaClassesTest-1142601802 tempest-VolumeQuotaClassesTest-1142601802-project-admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:14.223236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:14.224570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:14.225374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:14.225936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] PATH_INFO: `/v3/users/50f37780346f4ef9a1cc226d09d9666c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:14.229273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f37780346f4ef9a1cc226d09d9666c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:14.232671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:14.328430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f37780346f4ef9a1cc226d09d9666c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.343921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f37780346f4ef9a1cc226d09d9666c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.355925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f37780346f4ef9a1cc226d09d9666c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.372743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f37780346f4ef9a1cc226d09d9666c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.373536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f37780346f4ef9a1cc226d09d9666c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.380348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 915/1792] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:13 2022] DELETE /identity/v3/users/50f37780346f4ef9a1cc226d09d9666c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:14.385285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:14.386251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:14.386751 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:14.424738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:14.426391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:14.505985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:14.507448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:14.585790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 878/1793] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:14.614412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:14.615565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7520b9-3604-44ca-81bf-cffcde493985 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:14.615899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:14.621135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:14.622245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:14.622628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:14.623063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] PATH_INFO: `/v3/users/bb7d971490474c2092c1d13a24afa444` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:14.624641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7d971490474c2092c1d13a24afa444)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:14.627085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:14.706125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7d971490474c2092c1d13a24afa444'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.708581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1086ddd-f62b-408a-b888-a0f81b832cc9 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:14.720849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:14.721205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7d971490474c2092c1d13a24afa444'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.722512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:14.722996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:14.723545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:14.741313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7d971490474c2092c1d13a24afa444'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.743351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:14.745863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821db4-dffe-43e7-b882-b204f0f83ab7 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:14.758743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 879/1794] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:14.774918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7d971490474c2092c1d13a24afa444'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.776060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7d971490474c2092c1d13a24afa444'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:14.787300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 916/1795] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:14 2022] DELETE /identity/v3/users/bb7d971490474c2092c1d13a24afa444 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:14.792111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b569-6362-4d48-a973-a335ada220b6 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:14.792777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b569-6362-4d48-a973-a335ada220b6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:14.793203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b569-6362-4d48-a973-a335ada220b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:14.838619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ff33b569-6362-4d48-a973-a335ada220b6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:14.840114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ff33b569-6362-4d48-a973-a335ada220b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:14.915043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 880/1796] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:14.957938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:14.959497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:15.032497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71cc0e-a02e-4911-89a0-abc6c532b7b8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:15.038052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:15.040724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:15.041638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:15.041638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:15.055071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:15.056875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f602d8-361c-4517-b375-bc8814bddb6e service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:15.068919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 917/1797] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:15.628521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:15.629296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:15.629296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:15.631096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 881/1798] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:51:15.702292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:15.702875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:15.702875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:15.726959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:15.728363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:15.781592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:15.789605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:15.848652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 918/1799] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:51:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:15.853648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee067d-58ad-48b9-a89a-11cbf6c43ba2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:15.860176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:15.862237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:15.862512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:15.862779 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] PATH_INFO: `/v3/projects/433efb63a3524793bda4313ab3834790` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:15.864184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=433efb63a3524793bda4313ab3834790)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:15.866522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:15.946491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433efb63a3524793bda4313ab3834790', 'request_id': 'req-45c3123d-5534-4916-bc75-e48bdd11cd3b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:15.954744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433efb63a3524793bda4313ab3834790', 'request_id': 'req-45c3123d-5534-4916-bc75-e48bdd11cd3b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:15.972146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433efb63a3524793bda4313ab3834790', 'request_id': 'req-45c3123d-5534-4916-bc75-e48bdd11cd3b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:15.996407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] The token cache is being invalidate because project 433efb63a3524793bda4313ab3834790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:15.996720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:15.997638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.000708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 882/1800] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:15 2022] DELETE /identity/v3/projects/433efb63a3524793bda4313ab3834790 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:16.004981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:16.032142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905d12d-e0ab-4a9a-af36-1e8a739ce14e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:16.082846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:16.084393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.187143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:16.188707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.189557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.190212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] PATH_INFO: `/v3/users/34cd0c1a33ed4af0961668969f55c704` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.192293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cd0c1a33ed4af0961668969f55c704)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:16.195741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:16.229853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3123d-5534-4916-bc75-e48bdd11cd3b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:16.239338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:16.241383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.241836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.242100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.246040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.266767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cd0c1a33ed4af0961668969f55c704'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.279397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:16.281260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:16.285239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cd0c1a33ed4af0961668969f55c704'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.298612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cd0c1a33ed4af0961668969f55c704'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.326495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 883/1801] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:16.326707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cd0c1a33ed4af0961668969f55c704'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.327206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:16.327313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cd0c1a33ed4af0961668969f55c704'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.340885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.345867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 919/1802] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:16 2022] DELETE /identity/v3/users/34cd0c1a33ed4af0961668969f55c704 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:16.361001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb144a8-d402-4a53-949e-1e09e0830824 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:16.477122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:16.478801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.479852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.480327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] PATH_INFO: `/v3/projects/e0797ebc5e424833840c6317e344cb32` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.482454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0797ebc5e424833840c6317e344cb32)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:16.485582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:16.559012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0797ebc5e424833840c6317e344cb32', 'request_id': 'req-ffd5e904-723f-4b1b-85d1-da60c2cc0377'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.568956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0797ebc5e424833840c6317e344cb32', 'request_id': 'req-ffd5e904-723f-4b1b-85d1-da60c2cc0377'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.579149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0797ebc5e424833840c6317e344cb32', 'request_id': 'req-ffd5e904-723f-4b1b-85d1-da60c2cc0377'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.598286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] The token cache is being invalidate because project e0797ebc5e424833840c6317e344cb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:16.598664 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.599395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.601168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 884/1803] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:16 2022] DELETE /identity/v3/projects/e0797ebc5e424833840c6317e344cb32 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:16.606694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:16.608711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.645333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421377-5cca-491c-8441-705c465c82ec admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:16.672669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:16.674635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.727943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:16.729470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.730115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.730411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] PATH_INFO: `/v3/users/27e583fc62004fc0a955130b180910b9` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.731690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e583fc62004fc0a955130b180910b9)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:16.733981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:16.749642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e904-723f-4b1b-85d1-da60c2cc0377 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:16.755732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:16.756628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.756905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.757185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] PATH_INFO: `/v3/projects/85dee3894a6346dc98770428a3bc54d8` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.758393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dee3894a6346dc98770428a3bc54d8)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:16.760468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:16.787845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e583fc62004fc0a955130b180910b9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.798943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e583fc62004fc0a955130b180910b9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.808509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e583fc62004fc0a955130b180910b9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.822049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e583fc62004fc0a955130b180910b9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.823053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-94ae5ceb-32c7-4743-87e9-4bfa2b256c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e583fc62004fc0a955130b180910b9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.824230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dee3894a6346dc98770428a3bc54d8', 'request_id': 'req-434d4d96-5df0-4bc3-ad6c-20fa866e4397'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.833384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 920/1804] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:16 2022] DELETE /identity/v3/users/27e583fc62004fc0a955130b180910b9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:16.833567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dee3894a6346dc98770428a3bc54d8', 'request_id': 'req-434d4d96-5df0-4bc3-ad6c-20fa866e4397'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.843808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dee3894a6346dc98770428a3bc54d8', 'request_id': 'req-434d4d96-5df0-4bc3-ad6c-20fa866e4397'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.870368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] The token cache is being invalidate because project 85dee3894a6346dc98770428a3bc54d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:16.870771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.873586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-434d4d96-5df0-4bc3-ad6c-20fa866e4397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:16.875833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 885/1805] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:16 2022] DELETE /identity/v3/projects/85dee3894a6346dc98770428a3bc54d8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:16.883303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6875-f862-4335-be80-0469a9687456 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.883633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6875-f862-4335-be80-0469a9687456 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.884007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6875-f862-4335-be80-0469a9687456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:16.907250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d86a6875-f862-4335-be80-0469a9687456 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:16.909336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d86a6875-f862-4335-be80-0469a9687456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:16.988433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 921/1806] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:16.996200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:16.996490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:16.996763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.020946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:17.022286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.032622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 886/1807] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:17.037259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6875-f862-4335-be80-0469a9687456 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.048834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6875-f862-4335-be80-0469a9687456 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.054610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.055548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.055996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.056414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.057330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:17.057788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.060615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.082153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 922/1808] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:17.083349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.096010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046f541-ae06-47a7-96d3-454afa586ce4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.101542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.102287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.102627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.102961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.103805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.105949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.139743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 887/1809] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:17.141436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.158022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778c86-9a08-43a5-9cda-632a30debb68 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.214625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.215322 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.215603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.215907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.216643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.218579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.244412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 923/1810] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:17.250948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.270745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760287b-3bae-4e11-b0e1-150bdffb2acd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.277208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.278084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.278321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.278701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.279541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.281701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.301398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 888/1811] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:17.305866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.316526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80ae0-b88e-42ec-b231-bcc36937aeab admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.330809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.332562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.332953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.333242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.336758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.338457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.360847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 924/1812] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:17.363301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.379272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa7cf-5b2d-44b6-8a1d-95f2c47ff584 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.391732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.393473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.394129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.395084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.395367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.395641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] PATH_INFO: `/v3/projects/9bedf6289f3b4934a6621289f6d20ecb/users/531b36d79c7b4dc1a213bc208feeee03/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.408101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66baba-ea61-4475-81e1-8756c3ef9e51 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.416597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.417910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.418517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.419025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] PATH_INFO: `/v3/projects/405a74587f214a758f63202c1a844539` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.423398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=405a74587f214a758f63202c1a844539)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.426154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.432431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bedf6289f3b4934a6621289f6d20ecb, user_id=531b36d79c7b4dc1a213bc208feeee03, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.435476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac3b2-d9ab-4203-b756-1166fe86d934 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.460165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 889/1813] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:17 2022] PUT /identity/v3/projects/9bedf6289f3b4934a6621289f6d20ecb/users/531b36d79c7b4dc1a213bc208feeee03/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:17.471626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.471938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.472222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.502580 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405a74587f214a758f63202c1a844539', 'request_id': 'req-fede7059-e815-4b50-91dd-0bd2865fbbeb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:17.507856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] MFA Rules not processed for user `531b36d79c7b4dc1a213bc208feeee03`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:17.509770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405a74587f214a758f63202c1a844539', 'request_id': 'req-fede7059-e815-4b50-91dd-0bd2865fbbeb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:17.510580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.521148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405a74587f214a758f63202c1a844539', 'request_id': 'req-fede7059-e815-4b50-91dd-0bd2865fbbeb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:17.534804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] The token cache is being invalidate because project 405a74587f214a758f63202c1a844539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:17.535090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:17.535873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fede7059-e815-4b50-91dd-0bd2865fbbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:17.537946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 925/1814] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:17 2022] DELETE /identity/v3/projects/405a74587f214a758f63202c1a844539 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:17.542915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a38a-8d13-4374-9bfc-d9fb585527af None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.543202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a38a-8d13-4374-9bfc-d9fb585527af None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.543480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a38a-8d13-4374-9bfc-d9fb585527af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.564456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1948a38a-8d13-4374-9bfc-d9fb585527af None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:17.565974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1948a38a-8d13-4374-9bfc-d9fb585527af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.617480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 890/1815] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:17.624918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.627179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.637192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 926/1816] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:17.645305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.645741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.645934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec5d8d-b1f7-4175-a11e-fc4a9e0abb9a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.646209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.652264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.653418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.653976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.654254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.655602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.658573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.674731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:17.676591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:17.688045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 927/1817] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:17.693068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.706295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e415-19f8-4ffc-a145-9631261d8ace None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.707279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 891/1818] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:17.708272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.788346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.789196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.790146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.790533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.791352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:17.791752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.794231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.811710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 928/1819] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:17.816034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.839693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7fd5-68b4-4bb3-b7f7-111858ae0bda admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.843886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212be57-120e-4c44-bf8b-552b86bc2779 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:17.852681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.853630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.853907 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.854181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.854916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.855765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:17.856491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:17.856776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:17.856951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.857048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:17.857940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:17.861254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:17.898369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 892/1820] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:17.903480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.925428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 929/1821] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:17.927145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:17.929985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdece44-bd18-404e-8e5b-d44804422c60 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.003448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.004283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.004659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.004996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.005992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.008790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.012677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b320-3f9c-4f46-8a79-cd770d1130f4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.020328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.021246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.021752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.022172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.023114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.024949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 893/1822] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:18.026052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.026523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.046505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95430-5947-456c-be8d-92377e2809ed admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.059845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 930/1823] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:17 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:18.062484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.064706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.067945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.068441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.068441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.072478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.074654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.101774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8b56a-27c6-408b-a2cc-151cc87afea9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.125085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.125786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.126066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.126337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.127130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.128755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.135125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 894/1824] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:18.146836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.160781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 931/1825] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:18.161122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39473c9-4158-4c79-b9df-5bda46acd5d8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.164019 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.166942 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.168132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.169218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.169946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] PATH_INFO: `/v3/projects/fedd54bc9aa04fb58d4deca4997ff4cc/users/d6477ded98da4e0abe54e0e34f78854e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.184918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515c033-1eb3-4e59-92bf-149e90bef8cc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.193474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedd54bc9aa04fb58d4deca4997ff4cc, user_id=d6477ded98da4e0abe54e0e34f78854e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.197483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36292aed-6c91-4bdc-8578-4edcca5dee47 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.202414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.204802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.205755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.206147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.207138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.210546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.223149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 895/1826] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:18 2022] PUT /identity/v3/projects/fedd54bc9aa04fb58d4deca4997ff4cc/users/d6477ded98da4e0abe54e0e34f78854e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:18.240290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 932/1827] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:18.241109 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.241397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.241667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.245516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.264458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf220943-eb4d-4433-aae0-4bb6d7f51436 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.307334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] MFA Rules not processed for user `d6477ded98da4e0abe54e0e34f78854e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:18.309785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:18.418170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.419002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.419283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.419612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] PATH_INFO: `/v3/projects/150d732ff6be4a728619851dbe75615a/users/7539e7154899485ea6ee838ac254d024/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.467142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 896/1828] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:18.473701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.474081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150d732ff6be4a728619851dbe75615a, user_id=7539e7154899485ea6ee838ac254d024, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.495466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f9f7-40ce-4a0a-9d81-1c7e7958fe67 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.500756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfdbf4-1dac-4bf8-ba55-30011729c2f2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.520952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.522133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.522780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.523257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.524842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.527300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.527506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 933/1829] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:18 2022] PUT /identity/v3/projects/150d732ff6be4a728619851dbe75615a/users/7539e7154899485ea6ee838ac254d024/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:18.539155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.539806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.540282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.604735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 897/1830] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:18.605393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.610351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] MFA Rules not processed for user `7539e7154899485ea6ee838ac254d024`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:18.612038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:18.780577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a9d4-213e-4231-a420-23c6c088c392 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.785516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 934/1831] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:18.790357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.796005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.799190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.800629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.800922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.803542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.809480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.817732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97546c-4851-414a-95a2-e1a58938c6c5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:18.824833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:18.825591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:18.825872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:18.826201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:18.826937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:18.828978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:18.888655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 898/1832] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:18.890487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.902589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 935/1833] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:18.907210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:18.922822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103348-ec8b-42df-9b8f-9e82438d9bd9 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.089170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.089955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.090236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.090516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.091313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.093079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.118307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 899/1834] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:19.122609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.144087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae28a-f1d0-4e85-b366-dc8e23d9847f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.149655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.150376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.150656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.150929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.151876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.151991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f61a9-cc32-447a-b9b4-68cba9efb053 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.153852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.181395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.182691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.183696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.184127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] PATH_INFO: `/v3/projects/0430543e0d5d4199a1efa274514a101c/users/2115e02173fe4afc9e45638871a87a3a/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.188237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 936/1835] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:18 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:19.191996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.208217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0430543e0d5d4199a1efa274514a101c, user_id=2115e02173fe4afc9e45638871a87a3a, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.210520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0713-7e9a-4bf2-8ad1-001098e39609 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.211377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.224592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.225299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.225643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.225863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.226604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.228494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.246104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 900/1836] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:19 2022] PUT /identity/v3/projects/0430543e0d5d4199a1efa274514a101c/users/2115e02173fe4afc9e45638871a87a3a/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:19.247427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.251986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 937/1837] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:19.255996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.281872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fc69f-03bf-48b2-984d-60221668dbd9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.357290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff335b1-0650-458b-b8b8-042b25e0aaf8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.363329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.364083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.364381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.364699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.365952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.367803 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.383875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 901/1838] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:19.388311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.399585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.399858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc03f3d-dfac-42e0-80de-831d11bcac8a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.400729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.401079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.401465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] PATH_INFO: `/v3/projects/602f0639e04641d2948777ecc064a7ad/users/0a0ef7e963b0483f943a91fa9f435b4d/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.404559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.405929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.406198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.406460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] PATH_INFO: `/v3/projects/0430543e0d5d4199a1efa274514a101c/users/2115e02173fe4afc9e45638871a87a3a/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.408828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0430543e0d5d4199a1efa274514a101c, user_id=2115e02173fe4afc9e45638871a87a3a, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.411526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689f142-f196-4c5e-aec8-9e11b62ebaca admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.421076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=602f0639e04641d2948777ecc064a7ad, user_id=0a0ef7e963b0483f943a91fa9f435b4d, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.433729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 902/1839] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:19 2022] PUT /identity/v3/projects/0430543e0d5d4199a1efa274514a101c/users/2115e02173fe4afc9e45638871a87a3a/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:19.433944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.437788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.438124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.438478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.443193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 938/1840] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:19 2022] PUT /identity/v3/projects/602f0639e04641d2948777ecc064a7ad/users/0a0ef7e963b0483f943a91fa9f435b4d/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:19.447890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.474720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] MFA Rules not processed for user `2115e02173fe4afc9e45638871a87a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:19.476194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:19.525243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d7c0-24b6-4c34-991d-8590b09ca67f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.531130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.533150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.533462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.533739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.534489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.536219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.551525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 939/1841] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:19.555714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.580634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c4392-d7f0-4e62-9a5e-e44b6df64aad admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.583364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 903/1842] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:19.601346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.602284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.602572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.602848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] PATH_INFO: `/v3/projects/602f0639e04641d2948777ecc064a7ad/users/0a0ef7e963b0483f943a91fa9f435b4d/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.613702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.615176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=602f0639e04641d2948777ecc064a7ad, user_id=0a0ef7e963b0483f943a91fa9f435b4d, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.617917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:19.619510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea861d9-d4bd-4eed-bcab-3e9b70b6a23e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.641172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 940/1843] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:19 2022] PUT /identity/v3/projects/602f0639e04641d2948777ecc064a7ad/users/0a0ef7e963b0483f943a91fa9f435b4d/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:19.657543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.658057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.661220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.729028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] MFA Rules not processed for user `0a0ef7e963b0483f943a91fa9f435b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:19.732325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:19.766322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1adc0-1c8a-4d81-b920-61bc70f2ed12 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.889515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.891060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.891696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.892108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.911057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 941/1844] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:19.931055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:19.936306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:19.953629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d635c5-facc-4523-8487-83431fe92c46 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:19.959604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:19.960788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:19.961275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:19.961746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:19.976174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.978610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:19.991886 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:19.993412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:20.000896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 942/1845] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:20.028522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 904/1846] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:20.954566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:21.069369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:21.082239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f207419-7f8b-4805-965f-76490937ac32 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:21.091319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:21.092021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:21.092301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:21.092573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:21.103463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90e6b-c47c-4292-bdee-67f17f931368 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:21.118541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:21.119935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:21.121517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:21.125979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] PATH_INFO: `/v3/users/7539e7154899485ea6ee838ac254d024` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:21.128695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7539e7154899485ea6ee838ac254d024)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:21.131932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:21.223336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:21.228796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7109ff-edff-4db4-b318-52dfb18ee7bb service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:21.247752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 905/1847] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:21.263379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7539e7154899485ea6ee838ac254d024'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.289582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7539e7154899485ea6ee838ac254d024'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.303605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7539e7154899485ea6ee838ac254d024'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.341123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7539e7154899485ea6ee838ac254d024'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.342106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7539e7154899485ea6ee838ac254d024'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.349281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 943/1848] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:20 2022] DELETE /identity/v3/users/7539e7154899485ea6ee838ac254d024 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:21.353844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:21.354173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:21.354442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:21.372773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:21.374002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:21.438266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 906/1849] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:21.449571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:21.451210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:21.529053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e855-aa95-4b0d-9cd4-a1a8786a9dc4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:21.533406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:21.534086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:21.534360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:21.534633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:21.545889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:21.547659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:21.558830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 944/1850] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:21.853015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:21.854572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:21.871407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798c6f-140f-45fd-bd4c-cb24739773d7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:21.884515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:21.885434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:21.885690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:21.886070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] PATH_INFO: `/v3/projects/150d732ff6be4a728619851dbe75615a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:21.887428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150d732ff6be4a728619851dbe75615a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:21.889464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:21.940011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150d732ff6be4a728619851dbe75615a', 'request_id': 'req-0b77f989-8635-46d0-89d7-c865bbfcaf66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.946274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150d732ff6be4a728619851dbe75615a', 'request_id': 'req-0b77f989-8635-46d0-89d7-c865bbfcaf66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.954342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150d732ff6be4a728619851dbe75615a', 'request_id': 'req-0b77f989-8635-46d0-89d7-c865bbfcaf66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.964617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] The token cache is being invalidate because project 150d732ff6be4a728619851dbe75615a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:21.964905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.965545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:21.967134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 907/1851] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:21 2022] DELETE /identity/v3/projects/150d732ff6be4a728619851dbe75615a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:21.971550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:21.981935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87596-e00a-4e0c-b4b6-331b2dbdcc0e service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:22.061883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:22.062821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.063096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.063370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] PATH_INFO: `/v3/users/0a0ef7e963b0483f943a91fa9f435b4d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.064838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0ef7e963b0483f943a91fa9f435b4d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:22.067014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:22.127159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0ef7e963b0483f943a91fa9f435b4d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.136832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0ef7e963b0483f943a91fa9f435b4d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.146270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0ef7e963b0483f943a91fa9f435b4d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.160336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0ef7e963b0483f943a91fa9f435b4d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.161093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ebd3f519-f2c7-4da6-88eb-70bf1225da68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0ef7e963b0483f943a91fa9f435b4d'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.167878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 945/1852] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:21 2022] DELETE /identity/v3/users/0a0ef7e963b0483f943a91fa9f435b4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:22.585762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:22.587542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:22.608349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77f989-8635-46d0-89d7-c865bbfcaf66 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:22.683076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:22.684034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.684281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.684553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] PATH_INFO: `/v3/projects/602f0639e04641d2948777ecc064a7ad` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.686380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=602f0639e04641d2948777ecc064a7ad)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:22.688580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:22.755454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602f0639e04641d2948777ecc064a7ad', 'request_id': 'req-87d3b594-32b8-46da-8d1c-479381a3aebd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.764257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602f0639e04641d2948777ecc064a7ad', 'request_id': 'req-87d3b594-32b8-46da-8d1c-479381a3aebd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.776843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602f0639e04641d2948777ecc064a7ad', 'request_id': 'req-87d3b594-32b8-46da-8d1c-479381a3aebd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.789330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] The token cache is being invalidate because project 602f0639e04641d2948777ecc064a7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:22.789645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.790407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-87d3b594-32b8-46da-8d1c-479381a3aebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:22.792623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 908/1853] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:22 2022] DELETE /identity/v3/projects/602f0639e04641d2948777ecc064a7ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:22.797540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.797870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.798146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.817436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:22.818836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:22.883629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 946/1854] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:22.892131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.892386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.892687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.916603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:22.917984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:22.926544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 909/1855] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:22.930995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:22.941738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b40296-3d7c-4405-8a04-537a393d10b2 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:22.946495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:22.947243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.947533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.947844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.948688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:22.948991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:22.950796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:22.964726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 947/1856] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:22.969224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:22.978776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b9413-097d-455a-bde6-473e3f4ed46e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:22.984136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:22.984800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:22.985132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:22.985347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:22.986312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:22.988175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.016404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 910/1857] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:22 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:23.020808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.032100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3451b9-5187-4c16-998a-a1212c67ffef admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.100296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.100977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.101262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.101536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.102254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.104272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.135142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 948/1858] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:23 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:23.137675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.150273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711a63-88ba-4ca9-8aff-2cb020ed8974 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.156128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.156830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.157112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.157492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.158151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.159816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.172279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 911/1859] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:23.177002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.187880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa12a2-17e7-4fc4-8684-4baf90b20f99 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.193242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.193933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.194357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.194637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.195413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.197123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3e0c-f9ec-4cb5-885c-f6a1047354e0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.209031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 949/1860] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:23.212282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.223613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d65e36-6082-4e92-9793-13994467100b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.230437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.231573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.231962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.232307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] PATH_INFO: `/v3/projects/865479d7efa34d6fb976484bddf5e2f7/users/ef61124355ff45998a2118bf25d7e022/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.254688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865479d7efa34d6fb976484bddf5e2f7, user_id=ef61124355ff45998a2118bf25d7e022, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.259557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.288189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 912/1861] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:23 2022] PUT /identity/v3/projects/865479d7efa34d6fb976484bddf5e2f7/users/ef61124355ff45998a2118bf25d7e022/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:23.301849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.302121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.302400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.355622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] MFA Rules not processed for user `ef61124355ff45998a2118bf25d7e022`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:23.359151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:23.439711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 950/1862] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:23.444998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.576319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3155a-4acf-4226-b243-4ce17624d7b7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.591615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.593771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.594056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.594474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.595048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.597225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.640807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 913/1863] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:23 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:23.644335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.665761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc3d27-9ab9-4a14-adaa-682e160206a7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.771791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.772939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.773447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.773990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.785641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.785641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.814583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 951/1864] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:23 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:23.818964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.832047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b522-7178-4149-b29b-6c2dfc7c6d72 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.837882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.838597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.838888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.839342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.840282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.841836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.856078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 914/1865] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:23.858986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.871124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930abb1-485c-4a0e-b869-0316967eb83d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:23.881150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:23.881150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:23.881150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:23.881665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] PATH_INFO: `/v3/projects/9f76e9444de848c98f8af3b1889268c7/users/2d2e743a41cd4348ab71e4179299bd8e/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:23.900242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f76e9444de848c98f8af3b1889268c7, user_id=2d2e743a41cd4348ab71e4179299bd8e, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:23.903830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:23.920361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 952/1866] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:23 2022] PUT /identity/v3/projects/9f76e9444de848c98f8af3b1889268c7/users/2d2e743a41cd4348ab71e4179299bd8e/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:23.924620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:23.937465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccaa77-5c11-47da-aedd-81287be5daa5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:24.020271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:24.021409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:24.021971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:24.022471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:24.025808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:24.029587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2f409-d97a-4867-b42f-52900a9a691c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:24.066456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 915/1867] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:24.067449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:24.080489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd9fa-fdd0-4f26-b3fb-0c8e3d9b5ab3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:24.098369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:24.100231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:24.101051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:24.102042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] PATH_INFO: `/v3/projects/9f76e9444de848c98f8af3b1889268c7/users/2d2e743a41cd4348ab71e4179299bd8e/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:24.107372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f76e9444de848c98f8af3b1889268c7, user_id=2d2e743a41cd4348ab71e4179299bd8e, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:24.115465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:24.136449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 953/1868] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:24 2022] PUT /identity/v3/projects/9f76e9444de848c98f8af3b1889268c7/users/2d2e743a41cd4348ab71e4179299bd8e/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:24.147511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:24.148004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:24.148182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:24.187573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] MFA Rules not processed for user `2d2e743a41cd4348ab71e4179299bd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:24.189712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:24.340351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 916/1869] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:24.347275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:24.353576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:24.417848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fbc2b-cc5f-4066-adb2-d58e47fbf5d9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:24.421675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:24.422342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:24.422637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:24.422897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:24.434468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:24.435960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:24.446476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 954/1870] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:25.605209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:25.614865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3590d4-aeaf-4d48-8419-5d95829bee3e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:25.618418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:25.619163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:25.619329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:25.619598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:25.621479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:25.684127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:25.685625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fe84c-303d-4e71-b692-f68c6fb60e1d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:25.702588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 917/1871] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:26.136883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:26.239653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d536ce-ec9f-438b-93ef-5b4055a3a7a1 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:26.245931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:26.247339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:26.247855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:26.248490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] PATH_INFO: `/v3/users/ef61124355ff45998a2118bf25d7e022` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:26.251088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef61124355ff45998a2118bf25d7e022)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:26.254438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:26.358153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef61124355ff45998a2118bf25d7e022'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:26.376406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef61124355ff45998a2118bf25d7e022'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:26.394733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef61124355ff45998a2118bf25d7e022'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:26.428871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef61124355ff45998a2118bf25d7e022'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:26.430154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef61124355ff45998a2118bf25d7e022'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:26.445664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 955/1872] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:26 2022] DELETE /identity/v3/users/ef61124355ff45998a2118bf25d7e022 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:26.449525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:26.450047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:26.450525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:26.499164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:26.500479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:26.626151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 918/1873] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:26.643859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:26.645604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:26.786846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2230c5-1475-4108-bffd-26c26d1b42b0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:26.796691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:26.797727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:26.798252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:26.798656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:26.813831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:26.815584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:26.834099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 956/1874] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:27.258147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:27.259696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:27.274730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb493-0d19-4269-a4f1-9873023cf9f5 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:27.280972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:27.282032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:27.282440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:27.282833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] PATH_INFO: `/v3/projects/865479d7efa34d6fb976484bddf5e2f7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:27.284847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865479d7efa34d6fb976484bddf5e2f7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:27.287378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:27.342137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865479d7efa34d6fb976484bddf5e2f7', 'request_id': 'req-c664f8f7-885d-497c-ad18-6b1ec3537075'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.348605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865479d7efa34d6fb976484bddf5e2f7', 'request_id': 'req-c664f8f7-885d-497c-ad18-6b1ec3537075'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.356782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865479d7efa34d6fb976484bddf5e2f7', 'request_id': 'req-c664f8f7-885d-497c-ad18-6b1ec3537075'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.366902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] The token cache is being invalidate because project 865479d7efa34d6fb976484bddf5e2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:27.367201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.368001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.369731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 919/1875] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:27 2022] DELETE /identity/v3/projects/865479d7efa34d6fb976484bddf5e2f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:27.374191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:27.385269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac9471-695b-4b38-8bf5-bc1993722b81 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:27.457350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:27.458161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:27.458440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:27.458703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] PATH_INFO: `/v3/users/2d2e743a41cd4348ab71e4179299bd8e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:27.460258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2e743a41cd4348ab71e4179299bd8e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:27.462283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:27.528491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2e743a41cd4348ab71e4179299bd8e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.539041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2e743a41cd4348ab71e4179299bd8e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.548764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2e743a41cd4348ab71e4179299bd8e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.564920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2e743a41cd4348ab71e4179299bd8e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.565701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9f76eaa3-43a0-4371-8a2f-c91cc5b97cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2e743a41cd4348ab71e4179299bd8e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:27.572705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 957/1876] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:27 2022] DELETE /identity/v3/users/2d2e743a41cd4348ab71e4179299bd8e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:27.922413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:27.925320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:27.940259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f8f7-885d-497c-ad18-6b1ec3537075 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.018160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.019312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.019914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.020227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] PATH_INFO: `/v3/projects/9f76e9444de848c98f8af3b1889268c7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.021489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f76e9444de848c98f8af3b1889268c7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.023492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.100285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f76e9444de848c98f8af3b1889268c7', 'request_id': 'req-d6b87056-5767-4958-bded-db2c7295ef51'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:28.112385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f76e9444de848c98f8af3b1889268c7', 'request_id': 'req-d6b87056-5767-4958-bded-db2c7295ef51'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:28.129033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f76e9444de848c98f8af3b1889268c7', 'request_id': 'req-d6b87056-5767-4958-bded-db2c7295ef51'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:28.156734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] The token cache is being invalidate because project 9f76e9444de848c98f8af3b1889268c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:28.157761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:28.158682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6b87056-5767-4958-bded-db2c7295ef51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:28.169052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 920/1877] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:27 2022] DELETE /identity/v3/projects/9f76e9444de848c98f8af3b1889268c7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:28.171720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.172098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.172616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.202561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:28.204333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:28.339264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 958/1878] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:28.355319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.356059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.356649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.392187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:28.394176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:28.406583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 921/1879] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:28.411916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.423522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7a9ec-9d7d-4d10-a4f2-f43ed3e5ea75 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.429148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.429845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.430123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.430403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.431153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:28.436161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.437804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.452402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 959/1880] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:51:28.456979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.473619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c65b74-8b19-4d5f-ac23-781c389d7420 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.478804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.479483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.479845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.480062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.480762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.482700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.508841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 922/1881] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:28 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:28.513149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.525149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cfd60-058e-4ed2-86d1-fbcf353ac35d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.630684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.631748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.632786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.633303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.634598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.641623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.684426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 960/1882] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:28 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:28.685381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.703457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b17e-9fd5-4948-b517-ca110a7b1a93 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.714430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.715246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.715615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.716390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.716935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.725290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.752315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 923/1883] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:28.757762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.773414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356fe5-a1b9-4f6d-ab0f-b193a1fd0609 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.783173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.783173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.783173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.783173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.785439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.787496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.804556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 961/1884] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:28.810839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.849122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979a02-9e24-4f66-b99f-1b248009db1e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:28.856308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:28.859845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.859845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.859845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] PATH_INFO: `/v3/projects/fef8973ab1474aab8cad61e5b59e2294/users/2c692da89d484bc482953655229d86a0/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:28.902364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef8973ab1474aab8cad61e5b59e2294, user_id=2c692da89d484bc482953655229d86a0, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:28.913791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d567de-6160-47a6-8848-ae2a001e2afb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:28.954868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 924/1885] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:28 2022] PUT /identity/v3/projects/fef8973ab1474aab8cad61e5b59e2294/users/2c692da89d484bc482953655229d86a0/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:28.966127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:28.969740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:28.975360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:28.975927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:28.976431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.015044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d831a-1892-499f-b11c-cc5e7c3e2b3c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.057280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] MFA Rules not processed for user `2c692da89d484bc482953655229d86a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:29.060052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.119065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.120424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.120706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.120983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] PATH_INFO: `/v3/users/531b36d79c7b4dc1a213bc208feeee03` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.122247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] RBAC: Authorizing `identity:delete_user(user_id=531b36d79c7b4dc1a213bc208feeee03)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.124278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.151916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 925/1886] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:29.165311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.166800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.194687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531b36d79c7b4dc1a213bc208feeee03'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.204445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531b36d79c7b4dc1a213bc208feeee03'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.215965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531b36d79c7b4dc1a213bc208feeee03'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.228078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531b36d79c7b4dc1a213bc208feeee03'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.228848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20887f00-29c9-4541-9877-ef51fe86611b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531b36d79c7b4dc1a213bc208feeee03'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.235088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 962/1887] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:28 2022] DELETE /identity/v3/users/531b36d79c7b4dc1a213bc208feeee03 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:29.240240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.240869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.241473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.257287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae702b2-0ad6-49d3-ad83-9504d3c98767 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.260671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:29.261980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.326742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.327575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.327891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.328166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.331046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.358112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 963/1888] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:29.371574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.375626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.422752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.424380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.436101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 926/1889] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:29.457042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad515-d07d-408f-a5c4-a5a9442ab4a7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.457631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.458676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.461233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.462102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.462384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.462655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.475379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.479314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386627f7-1d59-4aba-be98-824c87dc0d7d service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.484353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6dbe7-f464-4e9a-8bbb-52103c8c1ec2 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.488338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.489254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.489528 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.489804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] PATH_INFO: `/v3/users/2c692da89d484bc482953655229d86a0` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.491533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c692da89d484bc482953655229d86a0)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.493726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.503086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 964/1890] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:29.567709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c692da89d484bc482953655229d86a0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.570213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c692da89d484bc482953655229d86a0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.584768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c692da89d484bc482953655229d86a0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.585587 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c692da89d484bc482953655229d86a0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.594594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c692da89d484bc482953655229d86a0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.615711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 927/1891] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:29 2022] DELETE /identity/v3/users/2c692da89d484bc482953655229d86a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:29.620605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.620896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.621175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.640391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:29.641623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.718024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 965/1892] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:29.729840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.731346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.793525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960af13-0bc2-4800-8504-3c0bc7dae5c5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.798374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.799109 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.799446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.799825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.809724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.811703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:29.811818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.813391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.824206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 928/1893] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:29.830703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadd235-3699-4ccd-ac84-70144dbe9738 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:29.837236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:29.838296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:29.838908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:29.839320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] PATH_INFO: `/v3/projects/9bedf6289f3b4934a6621289f6d20ecb` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:29.840800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bedf6289f3b4934a6621289f6d20ecb)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:29.843071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:29.894265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bedf6289f3b4934a6621289f6d20ecb', 'request_id': 'req-2bdabf44-b574-467e-9d10-d7e41f377327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.902098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bedf6289f3b4934a6621289f6d20ecb', 'request_id': 'req-2bdabf44-b574-467e-9d10-d7e41f377327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.910921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bedf6289f3b4934a6621289f6d20ecb', 'request_id': 'req-2bdabf44-b574-467e-9d10-d7e41f377327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.922786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] The token cache is being invalidate because project 9bedf6289f3b4934a6621289f6d20ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:29.923083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.928076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:29.929877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 966/1894] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:29 2022] DELETE /identity/v3/projects/9bedf6289f3b4934a6621289f6d20ecb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:29.934298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:29.944951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf843c-6f11-4a31-b7aa-b3ff948ed2ab service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.012251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.013287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.013567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.013838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] PATH_INFO: `/v3/users/d6477ded98da4e0abe54e0e34f78854e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.015131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6477ded98da4e0abe54e0e34f78854e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.017149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.069519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6477ded98da4e0abe54e0e34f78854e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.070426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6477ded98da4e0abe54e0e34f78854e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.079433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6477ded98da4e0abe54e0e34f78854e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.080200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6477ded98da4e0abe54e0e34f78854e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.091728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-136ce1e4-d344-49da-98df-f8e1f5caaefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6477ded98da4e0abe54e0e34f78854e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.127472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 929/1895] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:29 2022] DELETE /identity/v3/users/d6477ded98da4e0abe54e0e34f78854e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:30.173198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.174883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:30.200955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdabf44-b574-467e-9d10-d7e41f377327 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.367918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.369773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.370093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.372185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] PATH_INFO: `/v3/projects/fef8973ab1474aab8cad61e5b59e2294` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.374234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef8973ab1474aab8cad61e5b59e2294)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.376351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.444944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef8973ab1474aab8cad61e5b59e2294', 'request_id': 'req-d4639deb-196c-446c-85e5-80ba4ebcadf4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.453154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef8973ab1474aab8cad61e5b59e2294', 'request_id': 'req-d4639deb-196c-446c-85e5-80ba4ebcadf4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.462960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef8973ab1474aab8cad61e5b59e2294', 'request_id': 'req-d4639deb-196c-446c-85e5-80ba4ebcadf4'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.477354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] The token cache is being invalidate because project fef8973ab1474aab8cad61e5b59e2294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:30.477750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.478530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d4639deb-196c-446c-85e5-80ba4ebcadf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.480320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 967/1896] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:30 2022] DELETE /identity/v3/projects/fef8973ab1474aab8cad61e5b59e2294 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:30.487473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.487811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.488092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.508589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:30.509722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:30.582379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 930/1897] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:30.584669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.585146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.585487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.608379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:30.611220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:30.621163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 968/1898] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:30.625522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.638563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58cf42-ddf3-4e8c-9d9b-b87061fbb9b3 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.643651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.644481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.644856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.645216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.646052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:30.646449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.648259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.666391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 931/1899] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:30.670574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.682070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd682eb-2412-44bf-9db5-706470382f6f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.691517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.692921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.693438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.693998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.695453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.700899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.751716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 969/1900] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:30 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:30.756352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.768818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94cd-fd3b-4f09-ab9b-f3ba749fd83d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.800732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.802956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:30.832463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.833876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.833876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.833876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.834644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.837087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.871513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 932/1901] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:30 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:30.876226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.896731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2010ca5-3f17-42ff-bf8a-cab8a9b41127 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.902166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.903216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.903479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.903855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] PATH_INFO: `/v3/projects/fedd54bc9aa04fb58d4deca4997ff4cc` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.905240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedd54bc9aa04fb58d4deca4997ff4cc)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.907212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.911481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0c4d-fdda-4ea7-9738-a7f26662abc1 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.918850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:30.919579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:30.919957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:30.920235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:30.921062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:30.922741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:30.945837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 933/1902] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:30.947150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:30.960119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bffe7-7c7e-426e-8fc3-56725c291d5c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:30.966663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedd54bc9aa04fb58d4deca4997ff4cc', 'request_id': 'req-8d41cdab-49ea-46fb-8759-e0ccaf992de8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.974468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedd54bc9aa04fb58d4deca4997ff4cc', 'request_id': 'req-8d41cdab-49ea-46fb-8759-e0ccaf992de8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:30.988924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedd54bc9aa04fb58d4deca4997ff4cc', 'request_id': 'req-8d41cdab-49ea-46fb-8759-e0ccaf992de8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.012272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] The token cache is being invalidate because project fedd54bc9aa04fb58d4deca4997ff4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:31.012481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.013428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.020729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 970/1903] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:30 2022] DELETE /identity/v3/projects/fedd54bc9aa04fb58d4deca4997ff4cc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:31.025471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.034472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.044601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.045937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.046230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.046499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.047239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.048919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.061027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 934/1904] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:31.072876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.076207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.089543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135226cf-61f1-41a0-a578-08cba016eaec admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.095279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.096255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.096623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.096911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] PATH_INFO: `/v3/projects/1a8997ada2ca4f5198a6f196a8275af8/users/53787dcba35a4ccebeb332b288acc1a5/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.114483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8997ada2ca4f5198a6f196a8275af8, user_id=53787dcba35a4ccebeb332b288acc1a5, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.117274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8172-d368-4b93-8d8f-234d640bff1f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.119088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41cdab-49ea-46fb-8759-e0ccaf992de8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.124680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.125675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.126032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.126371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] PATH_INFO: `/v3/users/2115e02173fe4afc9e45638871a87a3a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.127980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2115e02173fe4afc9e45638871a87a3a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.129973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.138822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 935/1905] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:31 2022] PUT /identity/v3/projects/1a8997ada2ca4f5198a6f196a8275af8/users/53787dcba35a4ccebeb332b288acc1a5/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:31.143296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.143643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.143953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.171558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] MFA Rules not processed for user `53787dcba35a4ccebeb332b288acc1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:31.172807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.179215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2115e02173fe4afc9e45638871a87a3a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.189418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2115e02173fe4afc9e45638871a87a3a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.198824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2115e02173fe4afc9e45638871a87a3a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.212723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2115e02173fe4afc9e45638871a87a3a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.213454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2115e02173fe4afc9e45638871a87a3a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.219651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 971/1906] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:31 2022] DELETE /identity/v3/users/2115e02173fe4afc9e45638871a87a3a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:31.242389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 936/1907] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:31.254525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.256132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.328024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632854d-3a0f-43d8-8cf2-aaabe06df421 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.337758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.338447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.340889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.341215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.405632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.408013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.420040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 972/1908] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:31.445451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.447483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.526267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec08b-8706-4a7c-b2da-498908a46ab4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.586766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.587705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.587997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.588920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] PATH_INFO: `/v3/users/53787dcba35a4ccebeb332b288acc1a5` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.590632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53787dcba35a4ccebeb332b288acc1a5)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.591441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.592346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.594074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.642920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1c9f-5387-4088-9baa-c1149820ebb6 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.648514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.650386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.650804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.651239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] PATH_INFO: `/v3/projects/0430543e0d5d4199a1efa274514a101c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.652876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0430543e0d5d4199a1efa274514a101c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.655560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.669506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53787dcba35a4ccebeb332b288acc1a5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.670276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53787dcba35a4ccebeb332b288acc1a5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.679608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53787dcba35a4ccebeb332b288acc1a5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.680326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53787dcba35a4ccebeb332b288acc1a5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.689272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afdd6b4c-027c-461c-8574-5bcbcd4f7469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53787dcba35a4ccebeb332b288acc1a5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.709602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0430543e0d5d4199a1efa274514a101c', 'request_id': 'req-b71de620-b837-45a7-bff1-82385759534a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.716032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0430543e0d5d4199a1efa274514a101c', 'request_id': 'req-b71de620-b837-45a7-bff1-82385759534a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.717104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 937/1909] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:31 2022] DELETE /identity/v3/users/53787dcba35a4ccebeb332b288acc1a5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:31.723147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.723606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.725087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.730623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0430543e0d5d4199a1efa274514a101c', 'request_id': 'req-b71de620-b837-45a7-bff1-82385759534a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.742550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] The token cache is being invalidate because project 0430543e0d5d4199a1efa274514a101c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:31.743065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.743837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b71de620-b837-45a7-bff1-82385759534a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:31.745535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 973/1910] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:31 2022] DELETE /identity/v3/projects/0430543e0d5d4199a1efa274514a101c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:31.747374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:31.749138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.751409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5a1d-c82b-4a26-9b40-27350a741cb2 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.751793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5a1d-c82b-4a26-9b40-27350a741cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.752151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5a1d-c82b-4a26-9b40-27350a741cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.783660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f2ff5a1d-c82b-4a26-9b40-27350a741cb2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:31.785142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f2ff5a1d-c82b-4a26-9b40-27350a741cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.843885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 938/1911] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:31.853354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.853691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 974/1912] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:31.855066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.863127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.863483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.863992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.889462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:31.893592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:31.907656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 975/1913] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:31.914212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.927714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12981a94-84b2-4ea7-b602-7912b9780c82 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.936128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.936899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.937177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.937447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.938099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4c897-3cac-4bbe-919e-737e0d538e57 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.938252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:31.938560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.940610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.942545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.943229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.943513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.943825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.955736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.955946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 976/1914] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:31.956057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.959122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:31.969786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce25af-d773-465b-ac62-4856e1f594c2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:31.975210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:31.975963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:31.976316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:31.976656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:31.977432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:31.979477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:31.980850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 939/1915] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:51:32.015205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 977/1916] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:31 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:32.015950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.027693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946f62-916b-4686-a62d-ecc94a6d7261 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.101313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.102373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.102687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.102914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.107831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.110221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.145742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 940/1917] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:32.152663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.167340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed354-9d5c-4ecf-97cf-0353b3a6d1ee admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.177172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.178358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.178876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.179305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.180199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.182087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.201647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.202172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 978/1918] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:32.213791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d05aa-80f3-43d9-8058-6b2e927a1201 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.218930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.219836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.220116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.220382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.221112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.222884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672e384-17cd-4d44-8f53-f27b18438377 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.237781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 941/1919] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:32.241972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.252465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18fd23-8fdf-4c0e-b77c-05791a8e6960 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.257591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.258436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.258708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.258973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] PATH_INFO: `/v3/projects/52f98bf3a5f14880bdf2018e6ec03658/users/b076cbe353e442c28cd44556066b9327/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.276009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f98bf3a5f14880bdf2018e6ec03658, user_id=b076cbe353e442c28cd44556066b9327, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.279182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.295740 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 979/1920] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:32 2022] PUT /identity/v3/projects/52f98bf3a5f14880bdf2018e6ec03658/users/b076cbe353e442c28cd44556066b9327/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:32.307427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.307769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.308047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.346490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] MFA Rules not processed for user `b076cbe353e442c28cd44556066b9327`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:32.347757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:32.424109 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 942/1921] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:32.434060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.437439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:32.496090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.498829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:32.526693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdde9ab-08a3-4e8d-9758-89396d595dda admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.530675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.531352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.531636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.531967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.541548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.543311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f4e43-a585-4426-b596-41e131b7c769 service glance] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.554210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 980/1922] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:32.585403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a399b-58b6-4f22-a6cd-a1797084f2f7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.592298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.593713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.593713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.593951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] PATH_INFO: `/v3/projects/1a8997ada2ca4f5198a6f196a8275af8` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.595437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8997ada2ca4f5198a6f196a8275af8)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.597916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.670418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8997ada2ca4f5198a6f196a8275af8', 'request_id': 'req-b99d60dd-03bf-4e10-86db-db58e2833729'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:32.681359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8997ada2ca4f5198a6f196a8275af8', 'request_id': 'req-b99d60dd-03bf-4e10-86db-db58e2833729'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:32.701904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8997ada2ca4f5198a6f196a8275af8', 'request_id': 'req-b99d60dd-03bf-4e10-86db-db58e2833729'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:32.715485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] The token cache is being invalidate because project 1a8997ada2ca4f5198a6f196a8275af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:32.715800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:32.716470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b99d60dd-03bf-4e10-86db-db58e2833729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:32.718526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 943/1923] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:32 2022] DELETE /identity/v3/projects/1a8997ada2ca4f5198a6f196a8275af8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:32.723231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.724915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.725200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.744582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:32.745856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:32.808459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 981/1924] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:32.816524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.816809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.817080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.836732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:32.837955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:32.846979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 944/1925] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:32.851550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.861245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8634-b388-4fec-9e18-7e862a8336a5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.865930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.866622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.866896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.867163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.867931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:32.868241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.869914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.882928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 982/1926] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:32.888573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.903765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6a2e4-bda5-40c6-a1e7-8f932f3ff3a6 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:32.910975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:32.911825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:32.912263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:32.912661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:32.913518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:32.916027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:32.945791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 945/1927] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:32.950258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:32.960487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f70b-589b-4295-b3af-07865ed0139f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:33.038147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:33.038854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.039143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.039411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.040173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:33.048715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:33.102224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 983/1928] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:32 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:33.107940 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:33.118311 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2e6d-f8e2-497c-942d-4b01dc76984b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:33.123835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:33.124522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.124790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.125057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.125814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:33.127434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:33.142731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 946/1929] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:33.144097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:33.154758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b26f4b-c74f-4cd1-bc30-25af78bb70f3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:33.159987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:33.160792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.161077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.161353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.162087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:33.163721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996d9e0-bf52-4c48-b9c8-ec34f94597f2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:33.176728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 984/1930] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:33.179116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:33.190477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7937d4-05bf-4353-8a00-c68b35d82010 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:33.195920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:33.196814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.197088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.197399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] PATH_INFO: `/v3/projects/7a7b7701044d429294eeb000cd0a405f/users/f2f4eb2dab1d412c89792b8f77b83c63/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.214959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7b7701044d429294eeb000cd0a405f, user_id=f2f4eb2dab1d412c89792b8f77b83c63, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:33.225812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:33.233530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 947/1931] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:33 2022] PUT /identity/v3/projects/7a7b7701044d429294eeb000cd0a405f/users/f2f4eb2dab1d412c89792b8f77b83c63/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:33.244240 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.244530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.244809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.270627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] MFA Rules not processed for user `f2f4eb2dab1d412c89792b8f77b83c63`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:33.271884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:33.341812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 985/1932] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:33.352822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:33.355122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:33.412717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c76b2-3bd9-4a02-9fa9-e0f353c04179 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:33.416887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:33.417610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:33.417892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:33.418162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:33.427509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:33.429067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac885-7099-4ece-a348-fe87a4511536 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:33.439989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 948/1933] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:36.629156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:36.746387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f082def-714a-4cbe-b487-7b28dbaf66a4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:36.759251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:36.760359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:36.761247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:36.761622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] PATH_INFO: `/v3/users/f2f4eb2dab1d412c89792b8f77b83c63` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:36.763191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f4eb2dab1d412c89792b8f77b83c63)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:36.765834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:36.824582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f4eb2dab1d412c89792b8f77b83c63'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:36.834005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f4eb2dab1d412c89792b8f77b83c63'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:36.841866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f4eb2dab1d412c89792b8f77b83c63'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:36.857122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f4eb2dab1d412c89792b8f77b83c63'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:36.857866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f4eb2dab1d412c89792b8f77b83c63'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:36.864344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 986/1934] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:36 2022] DELETE /identity/v3/users/f2f4eb2dab1d412c89792b8f77b83c63 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:36.868839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:36.869320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:36.869411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:36.888354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:36.889640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:36.953038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 949/1935] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:36.963377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:36.965153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:37.025346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da31ec-2ed0-42e8-a6ed-3f0904576aff admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:37.029335 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:37.030009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:37.030288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:37.030557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:37.040270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:37.041761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b550455-3612-4400-9b05-50fe31c79d65 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:37.053346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 987/1936] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:37.685856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:37.687319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:37.705123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ae37-76f3-48ae-b0ec-ca75d19809ba None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:37.711349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:37.712299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:37.714719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:37.714719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] PATH_INFO: `/v3/projects/7a7b7701044d429294eeb000cd0a405f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:37.716103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7b7701044d429294eeb000cd0a405f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:37.718328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:37.780033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7b7701044d429294eeb000cd0a405f', 'request_id': 'req-e273c022-4934-4d76-94ae-f43320263335'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:37.787350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7b7701044d429294eeb000cd0a405f', 'request_id': 'req-e273c022-4934-4d76-94ae-f43320263335'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:37.802624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7b7701044d429294eeb000cd0a405f', 'request_id': 'req-e273c022-4934-4d76-94ae-f43320263335'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:37.817786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] The token cache is being invalidate because project 7a7b7701044d429294eeb000cd0a405f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:37.818078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:37.818763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e273c022-4934-4d76-94ae-f43320263335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:37.821645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 950/1937] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:37 2022] DELETE /identity/v3/projects/7a7b7701044d429294eeb000cd0a405f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:37.826541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:37.827006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:37.827207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:37.847922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:37.849201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:37.917206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 988/1938] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:37.926316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:37.926846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:37.927036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:37.952784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:37.955148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:37.972789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 951/1939] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:51:37.974141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:37.985535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381378c8-825c-4d50-ab2e-a880cb71dc21 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:37.991167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:37.992086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:37.992464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:37.992829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:37.993682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:37.994082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:37.996079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.017417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 989/1940] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:38.019502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.029525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfacdf-2078-49c7-99d2-86bbac55651c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.034176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.034844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.035119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.035385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.036187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.038315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.072105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 952/1941] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:38 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:38.077044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.092983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6504e-6ae5-4a2a-95f8-2ed34a7fdea1 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.165203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.165894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.166175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.166444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.167367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.169452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.191257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 990/1942] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:38 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:38.196594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.208135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1bb2e-50d2-4943-9261-e5f69cbe299a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.213708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.214536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.214782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.215073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.215841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.217479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.228405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 953/1943] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:38.232646 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.245052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b44d-4976-4596-a782-c5931c637d1d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.252007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.253287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.253719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.254744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.255967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.257772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ab6b2-f679-45df-a993-4c36d84a809e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.270213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 991/1944] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:38.274769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.285322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3436-7027-43fe-bf7d-eb6025c69d7f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.290333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.291232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.291511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.291960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] PATH_INFO: `/v3/projects/87e91a88fb3b450cbd8cf8794ca426ee/users/e1a1ebc97cfb49d3af0fc95157482c5a/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.310141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e91a88fb3b450cbd8cf8794ca426ee, user_id=e1a1ebc97cfb49d3af0fc95157482c5a, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.313246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.345881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 954/1945] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:38 2022] PUT /identity/v3/projects/87e91a88fb3b450cbd8cf8794ca426ee/users/e1a1ebc97cfb49d3af0fc95157482c5a/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:38.351189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183f51-e291-48a7-a24f-3e447d46e09f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.351475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183f51-e291-48a7-a24f-3e447d46e09f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.351788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183f51-e291-48a7-a24f-3e447d46e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.382890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f5183f51-e291-48a7-a24f-3e447d46e09f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:38.384203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f5183f51-e291-48a7-a24f-3e447d46e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:38.468935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 992/1946] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:38.476310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:38.478838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:38.553591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad43f9d-abe6-44ba-9c11-3865a1518b42 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:38.558083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:38.558961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:38.559327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:38.559713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:38.570652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:38.572341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:38.585319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 955/1947] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:39.986973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5418b-97a9-4b1a-b9a7-ebd3f7b7f910 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:39.987594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5418b-97a9-4b1a-b9a7-ebd3f7b7f910 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:39.987594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5418b-97a9-4b1a-b9a7-ebd3f7b7f910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:40.025811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2cb5418b-97a9-4b1a-b9a7-ebd3f7b7f910 None None] MFA Rules not processed for user `e1a1ebc97cfb49d3af0fc95157482c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:40.028089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2cb5418b-97a9-4b1a-b9a7-ebd3f7b7f910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:40.192426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 993/1948] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:40.203537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:40.205151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:40.284830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36fbee-061d-4bb0-85c0-8d2b63e2886c service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:40.292889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:40.293736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:40.294194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:40.294644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:40.305821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:40.307861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:40.330662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 956/1949] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:41.707339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:41.708094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:41.708094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:41.727312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] MFA Rules not processed for user `e1a1ebc97cfb49d3af0fc95157482c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:41.728576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:41.736320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 994/1950] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:45.198030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:45.200091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:45.215439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6933ac-9f3b-44eb-89a9-c3c31a1c0dae service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:45.220234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:45.220944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:45.221246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:45.221512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:45.223562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:45.288168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:45.289652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:45.300024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 957/1951] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:54.124225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:54.127076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:54.146168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c82c4-cd5d-48a1-a03e-f7b248a2ac11 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:54.151730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:54.152655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.152939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.153216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] PATH_INFO: `/v3/users/c3854a6fd3aa40f6b91ff0827cb76bef` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.155201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3854a6fd3aa40f6b91ff0827cb76bef)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:54.156732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:54.205179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3854a6fd3aa40f6b91ff0827cb76bef'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.213356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3854a6fd3aa40f6b91ff0827cb76bef'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.222822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3854a6fd3aa40f6b91ff0827cb76bef'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.237878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3854a6fd3aa40f6b91ff0827cb76bef'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.238362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6e648581-9de0-41cc-966e-49458129558d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3854a6fd3aa40f6b91ff0827cb76bef'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.244693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 995/1952] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:51:54 2022] DELETE /identity/v3/users/c3854a6fd3aa40f6b91ff0827cb76bef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:54.601489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:54.621302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9971a-4d51-4bb8-8568-55dd01ce99b6 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:54.680056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:54.680986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.681382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.681669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] PATH_INFO: `/v3/projects/be010f31dec04a14af6c1a847055be84` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.682982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be010f31dec04a14af6c1a847055be84)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:54.684984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:54.732703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be010f31dec04a14af6c1a847055be84', 'request_id': 'req-e01c6161-c785-434c-912f-aba20350ba3e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.738835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be010f31dec04a14af6c1a847055be84', 'request_id': 'req-e01c6161-c785-434c-912f-aba20350ba3e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.747205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be010f31dec04a14af6c1a847055be84', 'request_id': 'req-e01c6161-c785-434c-912f-aba20350ba3e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.758409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] The token cache is being invalidate because project be010f31dec04a14af6c1a847055be84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:51:54.758693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.759372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e01c6161-c785-434c-912f-aba20350ba3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:51:54.761152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 958/1953] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:51:54 2022] DELETE /identity/v3/projects/be010f31dec04a14af6c1a847055be84 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:54.766158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc741-f412-4eae-96a3-19597731067c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.766474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc741-f412-4eae-96a3-19597731067c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.766773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc741-f412-4eae-96a3-19597731067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.787254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a96cc741-f412-4eae-96a3-19597731067c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:54.788604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a96cc741-f412-4eae-96a3-19597731067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:54.849303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 996/1954] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:54.857963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.858505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.858778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.877982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:54.879228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:54.887945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 959/1955] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:54.892358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cc741-f412-4eae-96a3-19597731067c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:54.902960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cc741-f412-4eae-96a3-19597731067c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:54.908994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:54.910160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.910449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.910677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.911413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:51:54.911766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:54.913507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:54.926550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 997/1956] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:51:54.931211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:54.941275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36ec9e-3e3e-4c10-a88e-6eac7540a420 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:54.946737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:54.947622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:54.948007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:54.948381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:54.949099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:54.951059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:54.982512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 960/1957] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:54 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:54.983847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:54.995202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fce22-1098-4a39-9a18-392c2d944979 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.059924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.060550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.060839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.061111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.061813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.063790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.084854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 998/1958] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:54 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:51:55.089816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.100863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f4ef-90a2-4f80-aeb0-33d143ca9230 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.107353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.108555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.108943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.109220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.110000 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.111689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.123553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 961/1959] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:51:55.127979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.138375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe7d3-d06f-4295-9328-2ef14ee59086 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.144524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.145225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.145505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.145779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.146503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.148161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300c23f-946a-45a0-b3a5-bc3d1269363a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.159132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 999/1960] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:55.163327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.173878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f1423-0cb5-458a-889e-1a693fff6690 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.179359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.180305 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.180618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.180889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] PATH_INFO: `/v3/projects/bb3001d4b7dd4f77bf71fba3e830962b/users/985399d1182c4b83b64426043391b14e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.195910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3001d4b7dd4f77bf71fba3e830962b, user_id=985399d1182c4b83b64426043391b14e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.198762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.214207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 962/1961] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:55 2022] PUT /identity/v3/projects/bb3001d4b7dd4f77bf71fba3e830962b/users/985399d1182c4b83b64426043391b14e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:55.224725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.225125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.225292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.251585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] MFA Rules not processed for user `985399d1182c4b83b64426043391b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:55.252850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:55.319404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1000/1962] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:55.324697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.413075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b279-aa24-4ca9-8bfc-e072fe28ad2c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.419032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.419750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.420024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.420290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.420980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.422902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.463718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 963/1963] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:51:55 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:55.466076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.478162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551432aa-8e4f-43bc-8b2f-c38a0f60c12d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.540123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.541001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.541490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.541875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.542804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.545298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.568772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1001/1964] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:51:55 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:51:55.572996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.583801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ddaa3-152b-48f6-ad58-da23573c15a2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.589108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.589851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.590124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.590404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.591216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.593015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.606391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 964/1965] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:55.610600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.625366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6dbf2-1227-4ff8-baf7-f4911135363a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.633576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.635609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.636017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.636389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] PATH_INFO: `/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d/users/4b6ac600f5f542ccafae6d9ce4524bc4/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.661334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e6e6c875b4d77aa051d14f0c7244d, user_id=4b6ac600f5f542ccafae6d9ce4524bc4, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.664681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.681644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1002/1966] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:55 2022] PUT /identity/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d/users/4b6ac600f5f542ccafae6d9ce4524bc4/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:51:55.686251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.698348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a48e8-74a5-4b4d-9347-936a0a5bfde4 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.761326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.762360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.762634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.762902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.763894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.765691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dbefa-29fa-4c4a-a057-fcd4c0936a9f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.778253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 965/1967] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:51:55.783131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.794543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2b6f7-9ed0-4e47-aadb-ae76d73e2536 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:55.799954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:55.801001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.801379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.801737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] PATH_INFO: `/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d/users/4b6ac600f5f542ccafae6d9ce4524bc4/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.804042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e6e6c875b4d77aa051d14f0c7244d, user_id=4b6ac600f5f542ccafae6d9ce4524bc4, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:55.807094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:55.818584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1003/1968] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:51:55 2022] PUT /identity/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d/users/4b6ac600f5f542ccafae6d9ce4524bc4/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:51:55.830599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:55.830887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:55.831158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:55.859033 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] MFA Rules not processed for user `4b6ac600f5f542ccafae6d9ce4524bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:51:55.860228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:55.929692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 966/1969] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:51:55.941020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:55.943298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:56.008163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47d05-b74c-466c-aae8-be17671d50ea admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:56.012649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:56.013319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:56.013603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:56.013878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:56.074397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:56.075892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:56.087650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1004/1970] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:51:58.647214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:51:58.649446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:51:58.662763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2404e7-5a85-4c71-9f14-8e4bfd6965a1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:51:58.667866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:51:58.668550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:51:58.668830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:51:58.669101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:51:58.679708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:51:58.681218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:51:58.691344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 967/1971] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:07.413920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:07.416563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:07.577845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:07.580192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:07.650232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3671-1528-4c9e-9935-d62e8938f153 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:07.661857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:07.662088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:07.662772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:07.663254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] PATH_INFO: `/v3/users/b076cbe353e442c28cd44556066b9327` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:07.666320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b076cbe353e442c28cd44556066b9327)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:07.670774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:07.743481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b076cbe353e442c28cd44556066b9327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.755304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b076cbe353e442c28cd44556066b9327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.765167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b076cbe353e442c28cd44556066b9327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.770084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a0958-77bf-406f-9230-e026eb42e328 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:07.777798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:07.778708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:07.779139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:07.779583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] PATH_INFO: `/v3/users/f36fc81da7944caf91f37aa4778c1081` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:07.781178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36fc81da7944caf91f37aa4778c1081)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:07.782849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b076cbe353e442c28cd44556066b9327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.783211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:07.783989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d6244991-20b8-4729-a3b1-69a4fc139a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b076cbe353e442c28cd44556066b9327'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.793793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1005/1972] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:07 2022] DELETE /identity/v3/users/b076cbe353e442c28cd44556066b9327 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:07.800866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:07.801703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:07.802136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:07.849391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36fc81da7944caf91f37aa4778c1081'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.850084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36fc81da7944caf91f37aa4778c1081'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.850933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:07.853080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:07.858351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36fc81da7944caf91f37aa4778c1081'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.859046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36fc81da7944caf91f37aa4778c1081'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.867992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36fc81da7944caf91f37aa4778c1081'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:07.895937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 968/1973] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:07 2022] DELETE /identity/v3/users/f36fc81da7944caf91f37aa4778c1081 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:07.964140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1006/1974] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:07.981547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:07.985380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:08.131215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7679-5fe0-43bc-b804-b23bd97c65a4 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:08.136408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:08.137248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:08.137636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:08.137995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:08.239501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:08.241428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:08.273248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:08.276482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:08.285538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 969/1975] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:08.340248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceffc1-fdaa-4440-9a8b-7b2515816444 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:08.348200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:08.349737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:08.350180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:08.350593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] PATH_INFO: `/v3/projects/1a60ab9905494180a28680c72dce6c7b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:08.352511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a60ab9905494180a28680c72dce6c7b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:08.355184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:08.422683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a60ab9905494180a28680c72dce6c7b', 'request_id': 'req-e6dd377e-3abe-4774-be4e-affc6705a5bb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.434745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a60ab9905494180a28680c72dce6c7b', 'request_id': 'req-e6dd377e-3abe-4774-be4e-affc6705a5bb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.446229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a60ab9905494180a28680c72dce6c7b', 'request_id': 'req-e6dd377e-3abe-4774-be4e-affc6705a5bb'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.469903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] The token cache is being invalidate because project 1a60ab9905494180a28680c72dce6c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:08.470412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.471509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.474690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1007/1976] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:08 2022] DELETE /identity/v3/projects/1a60ab9905494180a28680c72dce6c7b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:08.480801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:08.492909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f6d1-a83c-40a2-b405-78968e9f6979 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:08.587251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:08.588667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:08.589049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:08.589399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] PATH_INFO: `/v3/users/fe6e7197eb314f32ae3d04171b759636` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:08.590855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6e7197eb314f32ae3d04171b759636)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:08.593227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:08.660693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6e7197eb314f32ae3d04171b759636'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.661668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6e7197eb314f32ae3d04171b759636'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.673096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6e7197eb314f32ae3d04171b759636'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.674005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6e7197eb314f32ae3d04171b759636'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.686881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6e7197eb314f32ae3d04171b759636'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.699778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:08.702168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:08.718549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 970/1977] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:08 2022] DELETE /identity/v3/users/fe6e7197eb314f32ae3d04171b759636 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:08.742088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd377e-3abe-4774-be4e-affc6705a5bb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:08.839902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:08.841645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:08.842363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:08.842592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] PATH_INFO: `/v3/projects/52f98bf3a5f14880bdf2018e6ec03658` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:08.845095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f98bf3a5f14880bdf2018e6ec03658)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:08.849038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:08.932360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f98bf3a5f14880bdf2018e6ec03658', 'request_id': 'req-e6088dac-d323-4ff4-a5f6-dc3465ca808a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.940260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f98bf3a5f14880bdf2018e6ec03658', 'request_id': 'req-e6088dac-d323-4ff4-a5f6-dc3465ca808a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.949510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f98bf3a5f14880bdf2018e6ec03658', 'request_id': 'req-e6088dac-d323-4ff4-a5f6-dc3465ca808a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.964694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] The token cache is being invalidate because project 52f98bf3a5f14880bdf2018e6ec03658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:08.965113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.965994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e6088dac-d323-4ff4-a5f6-dc3465ca808a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:08.971541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1008/1978] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:08 2022] DELETE /identity/v3/projects/52f98bf3a5f14880bdf2018e6ec03658 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:08.973124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:08.974874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:08.981097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027784-aa23-4720-9d59-388e8f61217a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:08.986492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027784-aa23-4720-9d59-388e8f61217a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:08.986870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027784-aa23-4720-9d59-388e8f61217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:08.995834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49cd4f-e4a0-4914-9730-d79ad5cd291c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.056991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-69027784-aa23-4720-9d59-388e8f61217a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:09.058801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-69027784-aa23-4720-9d59-388e8f61217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:09.092469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.093783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.094314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.094809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] PATH_INFO: `/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.096614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd90d8fc59ed457fbdf2e070e1d76f0f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.099704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.168741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1009/1979] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:09.170440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd90d8fc59ed457fbdf2e070e1d76f0f', 'request_id': 'req-58498310-8805-4bc8-bae5-6043d7a072ee'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:09.178890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.179597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.180152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.180256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd90d8fc59ed457fbdf2e070e1d76f0f', 'request_id': 'req-58498310-8805-4bc8-bae5-6043d7a072ee'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:09.191381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd90d8fc59ed457fbdf2e070e1d76f0f', 'request_id': 'req-58498310-8805-4bc8-bae5-6043d7a072ee'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:09.207517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] The token cache is being invalidate because project dd90d8fc59ed457fbdf2e070e1d76f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:09.209082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:09.209278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:09.209470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-58498310-8805-4bc8-bae5-6043d7a072ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:09.211294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:09.213582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 971/1980] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:08 2022] DELETE /identity/v3/projects/dd90d8fc59ed457fbdf2e070e1d76f0f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:09.229140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdab-1073-4fb2-9e3f-509f494c86ca None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.230276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdab-1073-4fb2-9e3f-509f494c86ca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.230877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdab-1073-4fb2-9e3f-509f494c86ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.268235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3d41fdab-1073-4fb2-9e3f-509f494c86ca None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:09.270275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3d41fdab-1073-4fb2-9e3f-509f494c86ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:09.326370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1010/1981] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:09.327785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.340484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f948-06aa-48f0-abc8-8c52243fec32 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.346003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.348010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.348481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.349009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.350081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:09.350459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.352318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.368131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1011/1982] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:09.371348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.393827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6936-7b7f-4d48-bc6b-41d2fefe2479 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.409148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 972/1983] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:09.410278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.412746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.413129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.413539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.415110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.415523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.415998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.419086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.422762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.438700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:09.440404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:09.452823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 973/1984] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:09.454657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.476933 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442f97-8db0-46a5-ac89-0e754abcb724 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.488376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1012/1985] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:09.494269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.599438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.600531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.601179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.601337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.602197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:09.602600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.605159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.622453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 974/1986] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:09.628154 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.630476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d97d-84ac-4348-bb9a-aee81be639a2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.639377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.639710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625199b-c6dd-4fae-9dd1-6d2f8543afdc admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.640672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.641246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.641743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.648089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.648259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.648259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.648259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.648259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.649214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.649365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.658104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.683884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1013/1987] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:09.690650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.703602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 975/1988] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:09.707832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.709088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf519e4-0301-4346-a33f-54d5b1237b98 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.786365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd8e5-c709-47e7-99b6-28e181f34f7e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.793628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.794522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.794889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.795252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.796246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.798657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.808810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.809769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.810114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.810445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.811295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.813092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.824018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1014/1989] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:09.830457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.833908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 976/1990] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:09.838638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.847386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639550af-384c-417b-8765-6db17ee44552 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.853167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23834ca9-eb77-41ea-a492-ecf896063d55 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.855144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.856250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.856707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.857158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.858461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.860261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.861250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.861390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.861677 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.862088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.863267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.866201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.878346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1015/1991] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:09.883841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 977/1992] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:09.884061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.895029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.900514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5831-d8f8-496a-adef-4ca4a28c503c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.903467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695a482-19ad-43f7-9ae9-6de377a83031 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.905789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.906971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.907414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.907970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] PATH_INFO: `/v3/projects/a4692ee5d2c64ec89610944f894a1836/users/da4c313808ee421b8478f298e31b7dfd/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.912188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.913029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.913460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.913975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.915258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.917378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.928977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 978/1993] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:09.933396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:09.936659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4692ee5d2c64ec89610944f894a1836, user_id=da4c313808ee421b8478f298e31b7dfd, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.942089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da0dc5-23ac-4a91-bd5a-52a5304b5316 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.943731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5192-f5fd-4e8b-a3c8-3efc88ab77b7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:09.949399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:09.950617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.951003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.951416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] PATH_INFO: `/v3/projects/aa9bf3bcba724632b7a15fa9d19d2056/users/44282951f5fc450dbac4dff6d6654a4e/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.965615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1016/1994] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:09 2022] PUT /identity/v3/projects/a4692ee5d2c64ec89610944f894a1836/users/da4c313808ee421b8478f298e31b7dfd/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:09.970851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9bf3bcba724632b7a15fa9d19d2056, user_id=44282951f5fc450dbac4dff6d6654a4e, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:09.973881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52ddb-cf17-49e5-81c3-b50e17970d8a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:09.985830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:09.986472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:09.986989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:09.996249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 979/1995] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:09 2022] PUT /identity/v3/projects/aa9bf3bcba724632b7a15fa9d19d2056/users/44282951f5fc450dbac4dff6d6654a4e/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:10.007214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:10.007526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:10.007861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:10.036503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] MFA Rules not processed for user `da4c313808ee421b8478f298e31b7dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:10.038575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:10.042943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] MFA Rules not processed for user `44282951f5fc450dbac4dff6d6654a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:10.044200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:10.131757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 980/1996] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:10.143923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:10.145409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:10.158052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1017/1997] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:10.177110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:10.179383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:10.214649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2de22-3dfa-4829-843f-478e84ac0d6b None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:10.219141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:10.219841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:10.220125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:10.220393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:10.234288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:10.237190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:10.251004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cc129-5454-498c-8595-929aadcc509d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:10.254996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:10.255247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 981/1998] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:10.256710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:10.257084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:10.257465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:10.269120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:10.270672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eb487-3670-4a66-847f-338df4f3434c service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:10.281393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1018/1999] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:11.939508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:11.941061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:12.000558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd928f-fa84-4bb5-b9b5-93be99400324 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:12.001568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd928f-fa84-4bb5-b9b5-93be99400324 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:12.001918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd928f-fa84-4bb5-b9b5-93be99400324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:12.021183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-82dd928f-fa84-4bb5-b9b5-93be99400324 None None] MFA Rules not processed for user `da4c313808ee421b8478f298e31b7dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:12.022510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82dd928f-fa84-4bb5-b9b5-93be99400324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:12.030603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1019/2000] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:12.085395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eacff-24e3-4948-aa89-610afca3a4ce service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:12.091756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:12.092654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:12.093012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:12.093175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] PATH_INFO: `/v3/users/985399d1182c4b83b64426043391b14e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:12.094387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] RBAC: Authorizing `identity:delete_user(user_id=985399d1182c4b83b64426043391b14e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:12.096781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:12.174825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985399d1182c4b83b64426043391b14e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.175724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985399d1182c4b83b64426043391b14e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.185153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985399d1182c4b83b64426043391b14e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.185975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985399d1182c4b83b64426043391b14e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.194736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985399d1182c4b83b64426043391b14e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.219935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 982/2001] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:11 2022] DELETE /identity/v3/users/985399d1182c4b83b64426043391b14e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:12.224883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:12.225277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:12.225595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:12.246755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:12.248885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:12.336170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1020/2002] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:12.362975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:12.364497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:12.446422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d6fd-1bd5-44e5-8e1a-f4d4df49538c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:12.452854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:12.454060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:12.454548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:12.455008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:12.466505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:12.468135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:12.480580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 983/2003] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:12.862531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:12.865345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:12.892806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c72c8-ddeb-4632-98ae-b51dce8e9d8a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:12.900571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:12.901829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:12.902174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:12.902633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] PATH_INFO: `/v3/projects/bb3001d4b7dd4f77bf71fba3e830962b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:12.905038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3001d4b7dd4f77bf71fba3e830962b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:12.908771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:12.974774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3001d4b7dd4f77bf71fba3e830962b', 'request_id': 'req-100e77a3-d682-4315-bb70-86390f998d12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:12.983161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3001d4b7dd4f77bf71fba3e830962b', 'request_id': 'req-100e77a3-d682-4315-bb70-86390f998d12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.000817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3001d4b7dd4f77bf71fba3e830962b', 'request_id': 'req-100e77a3-d682-4315-bb70-86390f998d12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.016320 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] The token cache is being invalidate because project bb3001d4b7dd4f77bf71fba3e830962b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:13.016630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.017377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.020543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1021/2004] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:12 2022] DELETE /identity/v3/projects/bb3001d4b7dd4f77bf71fba3e830962b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:13.024575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:13.035566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783675cc-ce99-41b7-9262-99545d6f5bd2 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:13.118827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:13.120085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:13.120362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:13.120958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] PATH_INFO: `/v3/users/4b6ac600f5f542ccafae6d9ce4524bc4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:13.123225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6ac600f5f542ccafae6d9ce4524bc4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:13.127413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:13.216821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6ac600f5f542ccafae6d9ce4524bc4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.217645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6ac600f5f542ccafae6d9ce4524bc4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.240141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6ac600f5f542ccafae6d9ce4524bc4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.241118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6ac600f5f542ccafae6d9ce4524bc4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.252861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c0e90065-a304-46ca-986b-0d3e5217d52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6ac600f5f542ccafae6d9ce4524bc4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.288429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 984/2005] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:13 2022] DELETE /identity/v3/users/4b6ac600f5f542ccafae6d9ce4524bc4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:13.716831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:13.721023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:13.748704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e77a3-d682-4315-bb70-86390f998d12 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:13.846570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:13.847542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:13.847854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:13.848452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] PATH_INFO: `/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:13.849993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1e6e6c875b4d77aa051d14f0c7244d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:13.852470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:13.961476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1e6e6c875b4d77aa051d14f0c7244d', 'request_id': 'req-48e5d93e-fb5b-4196-a49d-75d865114977'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.974116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1e6e6c875b4d77aa051d14f0c7244d', 'request_id': 'req-48e5d93e-fb5b-4196-a49d-75d865114977'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:13.986578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1e6e6c875b4d77aa051d14f0c7244d', 'request_id': 'req-48e5d93e-fb5b-4196-a49d-75d865114977'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:14.005692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] The token cache is being invalidate because project 9f1e6e6c875b4d77aa051d14f0c7244d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:14.006577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:14.006698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48e5d93e-fb5b-4196-a49d-75d865114977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:14.018853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1022/2006] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:13 2022] DELETE /identity/v3/projects/9f1e6e6c875b4d77aa051d14f0c7244d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:14.024434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.024720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.025472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.053531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:14.054382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:14.159060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 985/2007] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:14.168088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.168365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.168866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.199899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:14.202093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:14.217198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1023/2008] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:14.222848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.245069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9056-06e7-4c02-ab5e-10b54cc86a2c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.253463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.254746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.255489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.256205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.257586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:14.258144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.261416 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.284844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 986/2009] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:14.291158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.303270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95bbd0-0e1b-4a0f-8560-686c7ef910ef None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.309778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.310488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.310767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.311026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.311802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.313735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.349547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1024/2010] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:14.355468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.377116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b22eb-2c3a-415f-a032-d051c2e55532 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.486863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.489254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.491346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.492078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.493237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.496342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.531206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 987/2011] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:14.536358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.559586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4556a8-75b8-4c68-aef6-1ae8b8be646e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.570295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.571856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.572509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.573452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.575475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.579574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.602612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1025/2012] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:14.607214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.632047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1629-044d-448f-8cf5-11d3f6867a94 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.642061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.642876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.643243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.643576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.644570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.646538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3768cd-369e-4f64-98d7-0479daef7310 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.667485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 988/2013] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:14.669269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:14.684910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41912e-64a3-4095-b049-bd80124adc29 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:14.691377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:14.692548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.692883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.693337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] PATH_INFO: `/v3/projects/f2d111dcbc50405f98e16f38510a2fe6/users/9bbcb66cc97a4b3391b29b2420f11921/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.720201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d111dcbc50405f98e16f38510a2fe6, user_id=9bbcb66cc97a4b3391b29b2420f11921, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:14.725633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:14.761644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1026/2014] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:14 2022] PUT /identity/v3/projects/f2d111dcbc50405f98e16f38510a2fe6/users/9bbcb66cc97a4b3391b29b2420f11921/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:14.775398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:14.775721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:14.776008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:14.808341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] MFA Rules not processed for user `9bbcb66cc97a4b3391b29b2420f11921`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:14.809689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:14.930402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 989/2015] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:14.937625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.037668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbfa5d-1cbb-49c9-b2a7-461e7c520bd3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.046133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.047295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.047831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.048328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.049689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.053660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.125089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1027/2016] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:14 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:15.129939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.142374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832e06-3c9a-4b12-b0c9-64ef971f4c86 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.265878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.267093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.267598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.268138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.269600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.273659 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.317729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 990/2017] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:15 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:15.331794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.366408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7656-040f-4d31-9726-ad43c792b2ff admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.375465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.376841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.377331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.377787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.379744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.384112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.412138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1028/2018] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:15.414616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.435297 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e196-bbc5-46d5-8810-d4599750098e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.442497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.444360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.444872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.445230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] PATH_INFO: `/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5/users/d3c1d4c544e54f60b68a74fa7aefbd7c/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.476636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74c3c0ab2304f3ebdd244e069c268d5, user_id=d3c1d4c544e54f60b68a74fa7aefbd7c, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.483698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.507603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 991/2019] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:15 2022] PUT /identity/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5/users/d3c1d4c544e54f60b68a74fa7aefbd7c/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:15.514593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.533566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6472-1cc5-4e3b-bc62-e3b971005212 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.607622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.608787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.609470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.609956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.611898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.615285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf530-50e8-4053-bc72-b571a69d0920 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.640020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1029/2020] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:15.652875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.682543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf778-7d9e-45ec-95b7-eb87ceeef507 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:15.694881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:15.696317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.696935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.697509 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] PATH_INFO: `/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5/users/d3c1d4c544e54f60b68a74fa7aefbd7c/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.702361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74c3c0ab2304f3ebdd244e069c268d5, user_id=d3c1d4c544e54f60b68a74fa7aefbd7c, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:15.707439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:15.752001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 992/2021] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:15 2022] PUT /identity/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5/users/d3c1d4c544e54f60b68a74fa7aefbd7c/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:15.766444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:15.766921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:15.767398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:15.817765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] MFA Rules not processed for user `d3c1d4c544e54f60b68a74fa7aefbd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:15.819438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:15.945290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1030/2022] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:15.961123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:15.963794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:16.060503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c64b0-7582-40af-a841-5a9507a92b60 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:16.067792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:16.068918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:16.069756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:16.070266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:16.217553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:16.221885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b385eb-99d0-453d-88ff-8fccaa22d31c service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:16.241901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 993/2023] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:16.499928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:16.501797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:16.591839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bbfba-8bef-47af-8b3a-5bb38eae35ad None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:16.598867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:16.600549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:16.600806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:16.601429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] PATH_INFO: `/v3/users/44282951f5fc450dbac4dff6d6654a4e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:16.603782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44282951f5fc450dbac4dff6d6654a4e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:16.606412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:16.682966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44282951f5fc450dbac4dff6d6654a4e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:16.697204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44282951f5fc450dbac4dff6d6654a4e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:16.709615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44282951f5fc450dbac4dff6d6654a4e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:16.738437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44282951f5fc450dbac4dff6d6654a4e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:16.739513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44282951f5fc450dbac4dff6d6654a4e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:16.750555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1031/2024] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:16 2022] DELETE /identity/v3/users/44282951f5fc450dbac4dff6d6654a4e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:16.754590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:16.754941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:16.755464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:16.776289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:16.777879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:16.871839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 994/2025] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:16.883074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:16.884634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:16.969926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e232002-d141-4932-8473-09cbc4116099 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:16.974652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:16.975424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:16.975816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:16.976149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:16.988855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:16.990832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8460-76fa-488c-b05c-d76625fb5e73 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.004991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1032/2026] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:17.335071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.336696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:17.351427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ece-5ab3-4190-9ae8-a931591a9b1e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.357312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.358194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.358482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.359314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] PATH_INFO: `/v3/projects/aa9bf3bcba724632b7a15fa9d19d2056` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.361514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9bf3bcba724632b7a15fa9d19d2056)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.365015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.430985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9bf3bcba724632b7a15fa9d19d2056', 'request_id': 'req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:17.439755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9bf3bcba724632b7a15fa9d19d2056', 'request_id': 'req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:17.451315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9bf3bcba724632b7a15fa9d19d2056', 'request_id': 'req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:17.468868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] The token cache is being invalidate because project aa9bf3bcba724632b7a15fa9d19d2056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:17.469313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:17.470152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5bef4f8-5942-4632-b1b8-08f2798aa3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:17.472354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 995/2027] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:17 2022] DELETE /identity/v3/projects/aa9bf3bcba724632b7a15fa9d19d2056 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:17.478137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.478517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.478800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.501093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:17.502367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:17.572928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1033/2028] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:17.587540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.588146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.588691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.622361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:17.624614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:17.639562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 996/2029] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:17.646807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.662225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f4226-47ab-47ac-abd2-38d3e1857fe3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.669175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.669965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.670298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.672221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.672221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:17.672221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.674835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.691603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1034/2030] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:17.698628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.715950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd3f14-0d4f-4c9b-a50e-0c135105e421 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.724355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.725763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.726264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.726722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.728177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.732279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.774456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 997/2031] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:17 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:17.781379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.793482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda60e-cdd3-4d89-8e27-4f8db3a355b8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.862741 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.863965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.864548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.865038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.866610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.871145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.896127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1035/2032] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:17 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:17.902456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.919295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d864b-b1a8-46e1-8f77-2260f8365f9c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.924900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.925592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.925930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.926204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.926961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.928668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.945499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 998/2033] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:17.951578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:17.964139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a5955-eb29-4a40-9343-389566ff12e8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:17.971470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:17.973164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:17.973164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:17.973574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:17.974624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:17.977062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74948fbe-ccd4-4d8d-8b5c-e8f52afdecdc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:17.990882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1036/2034] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:17.996070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.008005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a071d52-28d7-4fd2-9bea-d44fd329db44 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.013598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.014655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.015015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.015429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] PATH_INFO: `/v3/projects/343260416aa347f7b84132fc22a08641/users/6a98959b46744cba98c029d08a06ab7c/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.032217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343260416aa347f7b84132fc22a08641, user_id=6a98959b46744cba98c029d08a06ab7c, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.034924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.051167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 999/2035] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:17 2022] PUT /identity/v3/projects/343260416aa347f7b84132fc22a08641/users/6a98959b46744cba98c029d08a06ab7c/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:18.062252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.062751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.062946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.094288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] MFA Rules not processed for user `6a98959b46744cba98c029d08a06ab7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:18.095586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:18.201658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1037/2036] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:18.203504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.284178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271116d-7f88-4ce2-982c-045a2cbded29 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.289460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.290146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.290436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.290719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.291460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.293681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.326647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1000/2037] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:18 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:18.328866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.346854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc9fd8-44a3-4240-ac65-6e3c88eb1835 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.450242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.451406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.451944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.452438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.453529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.457306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.488135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1038/2038] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:18 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:18.493023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.511489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f7c2-0be9-4e7b-ac82-e595d8d22a83 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.519798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.520952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.521420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.521889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.523267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.526809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.551808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1001/2039] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:18.554044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.568083 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917df1-fe7e-460c-b65c-995e483627c0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.573826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.574674 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.574999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.575319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.576169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.578160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21d9d-9b7e-41af-a041-2c0a6f8ced36 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.590767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1039/2040] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:18.595706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.607946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098c3e-5e5d-4bb0-92be-d0df4b08360b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.614113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.615059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.615309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.615610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] PATH_INFO: `/v3/projects/5fcdadea51c94f788ae37205416565cb/users/02966cd282734c06ab4c92f1fb8d77ee/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.634335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcdadea51c94f788ae37205416565cb, user_id=02966cd282734c06ab4c92f1fb8d77ee, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.637267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:18.657191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1002/2041] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:18 2022] PUT /identity/v3/projects/5fcdadea51c94f788ae37205416565cb/users/02966cd282734c06ab4c92f1fb8d77ee/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:18.670703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.671367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.671743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.714796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] MFA Rules not processed for user `02966cd282734c06ab4c92f1fb8d77ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:18.716299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:18.800350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1040/2042] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:18.805233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:18.938791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94104-e317-4930-af68-c8bfa4f9cd35 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:18.958722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:18.959479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:18.959798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:18.960079 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:18.960846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:18.968995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.024248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.026859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:19.058180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1003/2043] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:18 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:19.063366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.119079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d303ca1-b333-4a8f-8dfc-0213bf8c3b16 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.163882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72f08-bbb6-4a40-95ca-5d74b6d94473 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.169372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.170076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.170345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.171067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.171829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.175496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.176581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.177241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.177498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.177782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.179803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:19.198646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1004/2044] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:19 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:19.203052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.215742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741712a0-be33-489b-a999-1e41b536498f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.221113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.221817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.222093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.222367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.223096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.224900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.236689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1005/2045] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:19.243163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.254174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48aa7-7bc6-45dd-b2d9-f1973cdbc713 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.262333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.266330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.266823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.267329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] PATH_INFO: `/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f/users/b25f20efffbe47d2b025166f40b90b22/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.281543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.283360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.289860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7176c1cb46df4697a0966d0bcf05fe4f, user_id=b25f20efffbe47d2b025166f40b90b22, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.293479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.297162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1041/2046] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:19.316704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1006/2047] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:19 2022] PUT /identity/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f/users/b25f20efffbe47d2b025166f40b90b22/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:19.323133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.343353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec70397-1413-4d95-bdc7-2589b53c4fd9 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.469685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.471403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.472116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.472825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.474313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.477025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4b6f-d9e1-499d-8e47-d87c2f96bb49 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.503214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1042/2048] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:19.505903 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.527636 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7a22-1255-4ec0-98db-6b5c6089bcbe admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.536409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.537805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.538314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.538861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] PATH_INFO: `/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f/users/b25f20efffbe47d2b025166f40b90b22/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.542592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7176c1cb46df4697a0966d0bcf05fe4f, user_id=b25f20efffbe47d2b025166f40b90b22, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.547704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.572749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1007/2049] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:19 2022] PUT /identity/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f/users/b25f20efffbe47d2b025166f40b90b22/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:19.595761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.596627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.596826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.650091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] MFA Rules not processed for user `b25f20efffbe47d2b025166f40b90b22`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:19.652488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:19.755370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1043/2050] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:19.768214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:19.841282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e273b4-0593-4734-87e8-4911dbc7698f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:19.847995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:19.849361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:19.849842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:19.850322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:19.929501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:19.931031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:19.942251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1008/2051] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:21.627698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:21.629375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:21.642762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4d15-154c-433d-ab6a-4a11f18cca9f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:21.647364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:21.648082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:21.648379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:21.648653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:21.718205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:21.720145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:21.731972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1044/2052] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:22.518354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:22.534901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098d9b-71e0-4a07-9a79-8950c84895a1 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:22.541635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:22.542477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:22.543077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:22.543461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:22.558229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:22.560015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d190c-68c1-4001-af73-283340b6c5be service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:22.572465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1009/2053] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:23.412542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:23.414528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:23.500343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5caf-ece5-4e50-bf93-4ce4f6fdeddd service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:23.506255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:23.507182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:23.507613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:23.508722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] PATH_INFO: `/v3/users/9bbcb66cc97a4b3391b29b2420f11921` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:23.512898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbcb66cc97a4b3391b29b2420f11921)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:23.514975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:23.589874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbcb66cc97a4b3391b29b2420f11921'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:23.601129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbcb66cc97a4b3391b29b2420f11921'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:23.611610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbcb66cc97a4b3391b29b2420f11921'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:23.626106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbcb66cc97a4b3391b29b2420f11921'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:23.626916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbcb66cc97a4b3391b29b2420f11921'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:23.634106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1045/2054] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:23 2022] DELETE /identity/v3/users/9bbcb66cc97a4b3391b29b2420f11921 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:23.639536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:23.640263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:23.640263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:23.660372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:23.661915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:23.746507 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1010/2055] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:23.760796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:23.763411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:23.882137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caa339-2c40-4f69-8a86-d5b5aea2b480 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:23.892697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:23.893218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:23.893694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:23.894415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:23.917032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:23.920865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:23.951941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1046/2056] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:24.413320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:24.414854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:24.428433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7be90-8e61-4391-9484-605e1e50e2a3 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:24.434709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:24.435849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:24.436239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:24.436622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] PATH_INFO: `/v3/projects/f2d111dcbc50405f98e16f38510a2fe6` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:24.438156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d111dcbc50405f98e16f38510a2fe6)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:24.440672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:24.501883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d111dcbc50405f98e16f38510a2fe6', 'request_id': 'req-451f03a4-3c42-4bba-92bd-c010a85f6f76'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.509794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d111dcbc50405f98e16f38510a2fe6', 'request_id': 'req-451f03a4-3c42-4bba-92bd-c010a85f6f76'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.520592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d111dcbc50405f98e16f38510a2fe6', 'request_id': 'req-451f03a4-3c42-4bba-92bd-c010a85f6f76'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.535129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] The token cache is being invalidate because project f2d111dcbc50405f98e16f38510a2fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:24.535547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.536518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.538865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1011/2057] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:24 2022] DELETE /identity/v3/projects/f2d111dcbc50405f98e16f38510a2fe6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:24.544040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:24.554934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d386-e74e-4e36-a375-539c0b446d68 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:24.627936 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:24.628879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:24.629156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:24.629435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] PATH_INFO: `/v3/users/d3c1d4c544e54f60b68a74fa7aefbd7c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:24.630849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c1d4c544e54f60b68a74fa7aefbd7c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:24.632922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:24.693866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c1d4c544e54f60b68a74fa7aefbd7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.703607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c1d4c544e54f60b68a74fa7aefbd7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.712728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c1d4c544e54f60b68a74fa7aefbd7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.728956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c1d4c544e54f60b68a74fa7aefbd7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.729688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2e7b821d-70bb-49aa-83ae-94ebdc75b45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c1d4c544e54f60b68a74fa7aefbd7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:24.736738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1047/2058] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:24 2022] DELETE /identity/v3/users/d3c1d4c544e54f60b68a74fa7aefbd7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:25.125068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:25.126918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:25.149814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f03a4-3c42-4bba-92bd-c010a85f6f76 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:25.239361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:25.240626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.240912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.241176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] PATH_INFO: `/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.244439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74c3c0ab2304f3ebdd244e069c268d5)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:25.246649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:25.361167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74c3c0ab2304f3ebdd244e069c268d5', 'request_id': 'req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:25.371065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74c3c0ab2304f3ebdd244e069c268d5', 'request_id': 'req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:25.382885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74c3c0ab2304f3ebdd244e069c268d5', 'request_id': 'req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:25.402346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] The token cache is being invalidate because project d74c3c0ab2304f3ebdd244e069c268d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:25.402829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:25.403902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-afcd9652-cc5a-4352-a5c1-6b3e724ceb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:25.408492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1012/2059] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:25 2022] DELETE /identity/v3/projects/d74c3c0ab2304f3ebdd244e069c268d5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:25.414055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.414499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.415194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.455979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:25.457350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:25.534401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1048/2060] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:25.548568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.548873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.549373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.575860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:25.576817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:25.585341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1013/2061] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:25.591041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:25.601542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cfbd7-9d46-4275-b55a-482271c04b77 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:25.608352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:25.609412 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.609800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.610124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.611039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:25.611395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:25.613363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:25.626791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1049/2062] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:25.631798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:25.641939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bccd9-7ff2-4c04-bee6-003ecafd6dda None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:25.647022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:25.647931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.648242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.648515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.649684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:25.651769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:25.702653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1014/2063] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:25 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:25.707419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:25.745643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21c0-1e71-4965-a9b5-99c17609c39f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:25.906539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:25.907547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:25.908068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:25.908626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:25.909892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:25.912930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:25.955604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1050/2064] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:25 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:25.961229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.006516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2432-6e72-4eb3-8dc2-f7ab5499c6a8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.024055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.024866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.025142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.025412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.029173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.030921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.067096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1015/2065] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:26.067998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.093402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75e5c-24eb-4df8-96a8-d89b77028add admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.106382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.110077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.110713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.111959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.116590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.118513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223d02-e5e3-45b9-9196-364680a2a22c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.167026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.181461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1051/2066] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:26.182555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f924cf6-9aab-4d47-9fa5-b8f6160d36cb admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.189262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.190293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.190818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.191475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] PATH_INFO: `/v3/projects/da4d0f6aaffb46de90ca80322de1ed62/users/7d9ebe8a5afe48118cd7faa84d6c78ec/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.213490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4d0f6aaffb46de90ca80322de1ed62, user_id=7d9ebe8a5afe48118cd7faa84d6c78ec, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.217526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.239017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1016/2067] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:26 2022] PUT /identity/v3/projects/da4d0f6aaffb46de90ca80322de1ed62/users/7d9ebe8a5afe48118cd7faa84d6c78ec/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:26.251994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.251994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.252463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.290734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] MFA Rules not processed for user `7d9ebe8a5afe48118cd7faa84d6c78ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:26.292600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:26.396590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1052/2068] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:26.403938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.507355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612893-c815-4942-bee7-dbb7ec8b55b6 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.519250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.520370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.520878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.521385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.522978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.526729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.575076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1017/2069] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:26 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:26.577103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.590749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af76b5-718f-45c4-ad74-605ea6d024cd None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.672615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.673438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.673849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.674235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.675096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.677573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.705819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1053/2070] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:26 2022] POST /identity/v3/users => generated 300 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:26.710512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.724893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db096f8-b4d0-4a0c-932d-cb3d228563c6 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.730320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.731165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.731732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.732078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.732953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.735030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.750442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1018/2071] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:26.755177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.768451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081b67-2b46-4dd0-b2cb-6e85c9aefb55 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.775367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.776529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.776839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.777152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] PATH_INFO: `/v3/projects/63f02c1a9c024650ac4743cb1fbb8669/users/ad3e45cf3f284970b50463e6a5ab6741/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.799504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f02c1a9c024650ac4743cb1fbb8669, user_id=ad3e45cf3f284970b50463e6a5ab6741, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.803196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:26.850094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1054/2072] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:26 2022] PUT /identity/v3/projects/63f02c1a9c024650ac4743cb1fbb8669/users/ad3e45cf3f284970b50463e6a5ab6741/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:26.856229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:26.869242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbea9-de91-4e42-82b7-2656fca66c7f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:26.980206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:26.981106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:26.981452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:26.981796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:26.982642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:26.984614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.001985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.003148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1019/2073] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:27.006536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.007433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.024618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e032f-f9fb-439a-9e73-dd8ec9da99c8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:27.025260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd155-55e8-4ad8-9a6c-d04468127fce admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:27.031090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:27.033004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:27.033551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.034133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.034714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] PATH_INFO: `/v3/users/6a98959b46744cba98c029d08a06ab7c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.034852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.035245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.035938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] PATH_INFO: `/v3/projects/63f02c1a9c024650ac4743cb1fbb8669/users/ad3e45cf3f284970b50463e6a5ab6741/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.037616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a98959b46744cba98c029d08a06ab7c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:27.039732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f02c1a9c024650ac4743cb1fbb8669, user_id=ad3e45cf3f284970b50463e6a5ab6741, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:27.040902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.045744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb3a73-288c-42ae-a1fe-74bf862c01ea admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.067021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1020/2074] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:27 2022] PUT /identity/v3/projects/63f02c1a9c024650ac4743cb1fbb8669/users/ad3e45cf3f284970b50463e6a5ab6741/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:27.079641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.082286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.082709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.114835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a98959b46744cba98c029d08a06ab7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.128415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a98959b46744cba98c029d08a06ab7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.141181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a98959b46744cba98c029d08a06ab7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.144457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] MFA Rules not processed for user `ad3e45cf3f284970b50463e6a5ab6741`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:27.148082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.158796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a98959b46744cba98c029d08a06ab7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.159699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b5cf67e-069b-498d-83e9-4c97f1d09648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a98959b46744cba98c029d08a06ab7c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.167705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1055/2075] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:27 2022] DELETE /identity/v3/users/6a98959b46744cba98c029d08a06ab7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:27.174314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.174713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.175037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.199497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:27.201006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.273585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1021/2076] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:27.293201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1056/2077] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:27.299218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.301407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.306357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.308744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.384614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab52792-cc48-4b71-9627-6fae269a6809 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:27.389194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:27.389970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.390235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.390515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.395421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342b68-1d42-4169-8b6b-61daaf8e7195 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:27.402051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:27.403570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.418659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1057/2078] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:27.465046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:27.465793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.466077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.466518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.545481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:27.547108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c3cb8-dd38-48cc-bba1-3f539d54672e service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.558957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1022/2079] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:27.649945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.652310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.678367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd09cd-8d96-4b54-b323-54c9d9db3526 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:27.688135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:27.689829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.690310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.690822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] PATH_INFO: `/v3/users/7d9ebe8a5afe48118cd7faa84d6c78ec` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.693497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9ebe8a5afe48118cd7faa84d6c78ec)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:27.697144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:27.771024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9ebe8a5afe48118cd7faa84d6c78ec'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.782156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9ebe8a5afe48118cd7faa84d6c78ec'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.793467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9ebe8a5afe48118cd7faa84d6c78ec'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.809853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9ebe8a5afe48118cd7faa84d6c78ec'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.810813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9ebe8a5afe48118cd7faa84d6c78ec'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:27.820170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1058/2080] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:27 2022] DELETE /identity/v3/users/7d9ebe8a5afe48118cd7faa84d6c78ec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:27.826278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:27.826736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:27.827138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:27.855815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:27.862215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.904622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.906991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:27.954638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1023/2081] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:27.963809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:27.965514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:28.011717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56186fd-1fe8-41b6-8be2-4bb04133ed89 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:28.017844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:28.018982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:28.019270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:28.019573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] PATH_INFO: `/v3/projects/343260416aa347f7b84132fc22a08641` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:28.021011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=343260416aa347f7b84132fc22a08641)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:28.023140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:28.077517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0965-6329-4932-99af-174e56e2aa95 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:28.093445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343260416aa347f7b84132fc22a08641', 'request_id': 'req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.105912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343260416aa347f7b84132fc22a08641', 'request_id': 'req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.121637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343260416aa347f7b84132fc22a08641', 'request_id': 'req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.138257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] The token cache is being invalidate because project 343260416aa347f7b84132fc22a08641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:28.138866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.139984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.142192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1059/2082] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:27 2022] DELETE /identity/v3/projects/343260416aa347f7b84132fc22a08641 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:28.147312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:28.149956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:28.168260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:28.169245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:28.169986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:28.170569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:28.175495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:28.259442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b8ce8-c0f0-4807-a3a5-12cf2251c5fd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:28.270235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:28.272059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:28.272696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:28.273278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] PATH_INFO: `/v3/users/02966cd282734c06ab4c92f1fb8d77ee` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:28.279333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02966cd282734c06ab4c92f1fb8d77ee)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:28.286147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:28.293733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:28.297278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:28.329136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1024/2083] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:28.403594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02966cd282734c06ab4c92f1fb8d77ee'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.419003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02966cd282734c06ab4c92f1fb8d77ee'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.431709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02966cd282734c06ab4c92f1fb8d77ee'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.461036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02966cd282734c06ab4c92f1fb8d77ee'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.462567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02966cd282734c06ab4c92f1fb8d77ee'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:28.474718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1060/2084] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:28 2022] DELETE /identity/v3/users/02966cd282734c06ab4c92f1fb8d77ee => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:28.853381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:28.856966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:28.890241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5be70-483a-4bde-b6b7-51044a69fb5c service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:28.993003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:28.994098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:28.994542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:28.995066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] PATH_INFO: `/v3/projects/da4d0f6aaffb46de90ca80322de1ed62` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:28.997031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4d0f6aaffb46de90ca80322de1ed62)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:28.999517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:29.079126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4d0f6aaffb46de90ca80322de1ed62', 'request_id': 'req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.093481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4d0f6aaffb46de90ca80322de1ed62', 'request_id': 'req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.101389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:29.104930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:29.109684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4d0f6aaffb46de90ca80322de1ed62', 'request_id': 'req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.161653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff816e-2d35-44fe-9ece-eff351d829e6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:29.178047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] The token cache is being invalidate because project da4d0f6aaffb46de90ca80322de1ed62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:29.178574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.182485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.188790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1025/2085] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:28 2022] DELETE /identity/v3/projects/da4d0f6aaffb46de90ca80322de1ed62 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:29.194802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:29.200050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:29.379764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:29.381339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:29.381938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:29.382424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] PATH_INFO: `/v3/projects/5fcdadea51c94f788ae37205416565cb` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:29.384950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcdadea51c94f788ae37205416565cb)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:29.388561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:29.407175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75e91-d3ea-423d-8ae1-e02bdc93e5df admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:29.415852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:29.422633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:29.423049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:29.427852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] PATH_INFO: `/v3/users/ad3e45cf3f284970b50463e6a5ab6741` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:29.431485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e45cf3f284970b50463e6a5ab6741)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:29.435342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:29.541296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcdadea51c94f788ae37205416565cb', 'request_id': 'req-556d8313-c93e-48b9-b0c2-977c4e7db15a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.556641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcdadea51c94f788ae37205416565cb', 'request_id': 'req-556d8313-c93e-48b9-b0c2-977c4e7db15a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.600777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcdadea51c94f788ae37205416565cb', 'request_id': 'req-556d8313-c93e-48b9-b0c2-977c4e7db15a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.620659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] The token cache is being invalidate because project 5fcdadea51c94f788ae37205416565cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:29.621096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.621890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.623853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1061/2086] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:29 2022] DELETE /identity/v3/projects/5fcdadea51c94f788ae37205416565cb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:29.630116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:29.632512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:29.649488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e45cf3f284970b50463e6a5ab6741'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.650447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e45cf3f284970b50463e6a5ab6741'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.663314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e45cf3f284970b50463e6a5ab6741'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.669503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e45cf3f284970b50463e6a5ab6741'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.699504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e45cf3f284970b50463e6a5ab6741'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:29.741038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1026/2087] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:29 2022] DELETE /identity/v3/users/ad3e45cf3f284970b50463e6a5ab6741 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:29.798120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8313-c93e-48b9-b0c2-977c4e7db15a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:29.919637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:29.922685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:29.923017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:29.923352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] PATH_INFO: `/v3/users/b25f20efffbe47d2b025166f40b90b22` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:29.924904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25f20efffbe47d2b025166f40b90b22)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:29.927338 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:30.063789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25f20efffbe47d2b025166f40b90b22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.087317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25f20efffbe47d2b025166f40b90b22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.101850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25f20efffbe47d2b025166f40b90b22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.144422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25f20efffbe47d2b025166f40b90b22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.145258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-3f085a85-7e7c-4ff0-9d21-bc89ea381f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25f20efffbe47d2b025166f40b90b22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.159913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1062/2088] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:29 2022] DELETE /identity/v3/users/b25f20efffbe47d2b025166f40b90b22 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:30.441927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:30.445437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.469813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0068de-b405-40e8-88a8-4fa89c0eb75a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:30.478388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.478681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.478942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.513850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:30.515445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.586021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:30.587802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.588290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.588722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] PATH_INFO: `/v3/projects/63f02c1a9c024650ac4743cb1fbb8669` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.591308 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f02c1a9c024650ac4743cb1fbb8669)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:30.595782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:30.630779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1063/2089] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:30.632877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:30.635082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.656636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b368e-d335-48bf-8e98-127cc2a2e6ab None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:30.664673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:30.666742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.667243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.667778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] PATH_INFO: `/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.670473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7176c1cb46df4697a0966d0bcf05fe4f)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:30.674811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:30.695001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f02c1a9c024650ac4743cb1fbb8669', 'request_id': 'req-da0a2f7a-4598-46d3-a165-723905eb5fc7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.708040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f02c1a9c024650ac4743cb1fbb8669', 'request_id': 'req-da0a2f7a-4598-46d3-a165-723905eb5fc7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.719060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f02c1a9c024650ac4743cb1fbb8669', 'request_id': 'req-da0a2f7a-4598-46d3-a165-723905eb5fc7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.734139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] The token cache is being invalidate because project 63f02c1a9c024650ac4743cb1fbb8669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:30.734579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.735489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.737714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1027/2090] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:30 2022] DELETE /identity/v3/projects/63f02c1a9c024650ac4743cb1fbb8669 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:30.738869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:30.740802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.768033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7176c1cb46df4697a0966d0bcf05fe4f', 'request_id': 'req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.781017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7176c1cb46df4697a0966d0bcf05fe4f', 'request_id': 'req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.793574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7176c1cb46df4697a0966d0bcf05fe4f', 'request_id': 'req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.809836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] The token cache is being invalidate because project 7176c1cb46df4697a0966d0bcf05fe4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:30.810283 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.811255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-72cbaf7a-1abe-4a8e-b875-b106ce54f3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:30.813321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1064/2091] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:30 2022] DELETE /identity/v3/projects/7176c1cb46df4697a0966d0bcf05fe4f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:30.819272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8072e7-fa6f-43e5-9380-8a954218d5e1 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.819272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8072e7-fa6f-43e5-9380-8a954218d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.819272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8072e7-fa6f-43e5-9380-8a954218d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.848768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-bd8072e7-fa6f-43e5-9380-8a954218d5e1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:30.850265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bd8072e7-fa6f-43e5-9380-8a954218d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.856817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a2f7a-4598-46d3-a165-723905eb5fc7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:30.965922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1065/2092] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:30.967394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0aa1-7814-4982-b5b3-90700bb5ef6d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.967708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0aa1-7814-4982-b5b3-90700bb5ef6d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.967983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0aa1-7814-4982-b5b3-90700bb5ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.988791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7e3f0aa1-7814-4982-b5b3-90700bb5ef6d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:30.990154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7e3f0aa1-7814-4982-b5b3-90700bb5ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.991727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:30.992546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:30.993070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:30.993469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:30.995972 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:30.999254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1066/2093] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:31.000947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.001326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.001697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.011954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.014233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3e33-7928-4c57-be26-18fa28600d63 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.022270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:31.023492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:31.030243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1028/2094] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:31.032218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.032929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.033417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.033604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1067/2095] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:31.039067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.049889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db01d17-3bf6-4e1a-8c94-6efd7b2eb168 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.056312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.057254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.057594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.058038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.059126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:31.059477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.061576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.072877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:31.073182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:31.080118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1068/2096] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:31.081401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.092701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388aff-46fd-4c64-bd31-8b063cae6982 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.098293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.099158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.099539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.099947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.100794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.103014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.139451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1069/2097] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:31.144955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.175941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1029/2098] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:31.182532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.214621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b075633-9bd4-47c6-8a94-a96fbcfdb14a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.240131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e51c46-1b47-4edd-8f4a-904a64692b23 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.262232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.263327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.263734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.264154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.265766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.267325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.301362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1070/2099] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:31.305625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.329254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb5ae-ebf5-4154-acd6-ec098cd7fa5d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.339544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.341307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.342094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.342860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.344668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.350133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.352812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.353922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.354672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.355049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.356605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:31.357237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.359399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.375221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1071/2100] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:31.381486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.387736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1030/2101] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:52:31.394010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.422337 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7660e4-0612-433a-a475-190ee4f5d708 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.430988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de4e9-1edc-4c0c-8b4e-1a3012d03135 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.443843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.445182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.445722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.446147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.449524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.450649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.452405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.452951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.453560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.454555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.454949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.458810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.476116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1072/2102] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:31.478462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.491584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5e281-38bb-45b4-b222-30d92c3891d3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.499219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.500280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.500586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.500989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] PATH_INFO: `/v3/projects/ed5331b4296843deaa95406476f1168d/users/b4aaaaf81c084d2eae21666cbc23acbc/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.517062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1031/2103] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:31.523134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.535461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5331b4296843deaa95406476f1168d, user_id=b4aaaaf81c084d2eae21666cbc23acbc, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.539015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5ce64-817f-4555-a92a-44eaa15c5f94 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.582187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1073/2104] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:31 2022] PUT /identity/v3/projects/ed5331b4296843deaa95406476f1168d/users/b4aaaaf81c084d2eae21666cbc23acbc/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:31.587657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4535-17b5-418b-8207-42876356c705 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.588191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4535-17b5-418b-8207-42876356c705 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.588725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4535-17b5-418b-8207-42876356c705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.624579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21363f35-ec11-4566-a0fe-a4ca08a4bb73 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.667695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e38a4535-17b5-418b-8207-42876356c705 None None] MFA Rules not processed for user `b4aaaaf81c084d2eae21666cbc23acbc`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:31.669930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e38a4535-17b5-418b-8207-42876356c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:31.727791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.728939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.729417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.731040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.732370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.734739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.780076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1032/2105] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:31.781290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.796895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebbc2-642e-4d67-aaf6-a6b27d99f601 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.804786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.805701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.806182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.806598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.807514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.809586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.823979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1033/2106] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:31.828336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.837469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1074/2107] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:31.840745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af7a1-19af-41c0-929c-976f8f12dcc3 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.842693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4535-17b5-418b-8207-42876356c705 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.847029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.847929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.848259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.848576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.849555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.852055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.855611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4535-17b5-418b-8207-42876356c705 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.861389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.862073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.862354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.862839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.863636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.865761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.869207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1034/2108] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:31.874478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.894143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcf224-1299-427c-89db-312fb91dd077 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:31.903400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1075/2109] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:31.903638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:31.904808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:31.905301 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.905909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.906338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] PATH_INFO: `/v3/projects/20b74a3570eb424a930070d28a8b09e8/users/14f1429002ca444c8765018133dadc07/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.936838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b74a3570eb424a930070d28a8b09e8, user_id=14f1429002ca444c8765018133dadc07, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:31.942606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510780-ba44-4817-a2eb-641fd0117038 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:31.965375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1035/2110] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:31 2022] PUT /identity/v3/projects/20b74a3570eb424a930070d28a8b09e8/users/14f1429002ca444c8765018133dadc07/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:31.984088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:31.984559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:31.984956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:31.991817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d925e4-72e6-4173-860d-45216727a9e3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.019146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] MFA Rules not processed for user `14f1429002ca444c8765018133dadc07`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:32.020913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:32.075819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.077133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.077508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.077844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.078672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.080962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.118106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1076/2111] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:32.121817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.128298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1036/2112] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:32.136882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24eec-3785-4f99-ba19-9c5f9bb5a962 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.147339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.148972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.149629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.150213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.150423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.151261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.152498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:32.153378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.167725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1077/2113] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:32.173046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.185530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573af86-2a83-4d89-83ce-5b18289d0261 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.191121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.192415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.192765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.193210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] PATH_INFO: `/v3/projects/1c2945d61584455aab973c684b107c51/users/cbfe24da92e6421f980be44df7986763/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.218176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2945d61584455aab973c684b107c51, user_id=cbfe24da92e6421f980be44df7986763, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.222117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.244737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7101-e2b9-4186-8b24-3b7f65cc36f8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.246396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1078/2114] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:32 2022] PUT /identity/v3/projects/1c2945d61584455aab973c684b107c51/users/cbfe24da92e6421f980be44df7986763/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:32.252497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.326005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.326829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.327178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.327460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.349766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0afbd-df76-4b61-8614-010c86d51174 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.355496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.356269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.356553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.356906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.357675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.359450 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.377250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1079/2115] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:32.382511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.397179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b128-1804-4192-8b8f-7cc2ac26bbc3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.404101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.405747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.406498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.407037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] PATH_INFO: `/v3/projects/1c2945d61584455aab973c684b107c51/users/cbfe24da92e6421f980be44df7986763/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.411235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2945d61584455aab973c684b107c51, user_id=cbfe24da92e6421f980be44df7986763, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.411610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.414544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19bb21-abfc-4cba-b047-d89de3ea7d43 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.417236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.427258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1037/2116] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:32.434591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1080/2117] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:32 2022] PUT /identity/v3/projects/1c2945d61584455aab973c684b107c51/users/cbfe24da92e6421f980be44df7986763/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:32.448952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.449434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.449896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.497352 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] MFA Rules not processed for user `cbfe24da92e6421f980be44df7986763`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:32.500466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:32.677478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1038/2118] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:32.694204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:32.698806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:32.846481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded2a31-0d0c-4855-ae9f-368d1944dcc8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:32.860708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:32.861435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:32.862131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:32.862838 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:32.893996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:32.899583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9519-d156-4a4b-abbd-a0e109945bd0 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:32.919585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1081/2119] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:33.131958 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:33.165335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d619466-fa0b-45fe-89d4-e4eb263b6fca None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:33.172986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:33.175386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:33.175386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:33.175875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:33.265501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:33.268440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:33.286403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1039/2120] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:35.291708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:35.292826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:35.292826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:35.331999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:35.333887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:35.439115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1082/2121] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:35.459243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:35.513325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:35.515569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:35.596548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6d3d-278d-4f7d-a36b-7dd32267fc6a service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:35.604681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:35.606126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:35.606588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:35.607028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] PATH_INFO: `/v3/users/14f1429002ca444c8765018133dadc07` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:35.609319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f1429002ca444c8765018133dadc07)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:35.613403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:35.695185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f578c-271d-435c-9fc4-acd744e70831 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:35.708067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:35.709381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:35.709661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:35.711297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:35.732958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:35.736514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a3a38-fe52-4fa7-a3a5-fcefbf908c37 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:35.738682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f1429002ca444c8765018133dadc07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:35.740247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f1429002ca444c8765018133dadc07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:35.754455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1083/2122] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:52:35.774438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f1429002ca444c8765018133dadc07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:35.776143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f1429002ca444c8765018133dadc07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:35.790612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ea2489e7-9b71-4759-b617-dddfeafd250d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f1429002ca444c8765018133dadc07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:35.827135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1040/2123] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:35 2022] DELETE /identity/v3/users/14f1429002ca444c8765018133dadc07 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:35.834458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:35.834920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:35.835399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:35.857562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:35.858854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:35.858854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:35.868946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:35.871128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:35.895240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:35.897887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:35.976851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1084/2124] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:35.995359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:35.997112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:36.034477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1041/2125] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:36.057571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:36.059053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:36.096941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9838836-d74b-4877-ac3e-517b7f9c0b50 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:36.101620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:36.102550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:36.102996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:36.103385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:36.114800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:36.116529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:36.127709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1085/2126] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:36.227850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434841-a4b5-40a4-9889-d16be7fe2ae1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:36.239309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:36.240629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:36.241123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:36.242036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:36.266701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:36.269581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b7deb-0ca5-4497-8e72-663369a5e60c service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:36.297247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1042/2127] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:36.694491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:36.698924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:36.729077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542d9f8-2c4a-4a66-bcc6-6ad446f3f16b service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:36.744298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:36.746124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:36.746408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:36.746836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] PATH_INFO: `/v3/projects/20b74a3570eb424a930070d28a8b09e8` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:36.752900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b74a3570eb424a930070d28a8b09e8)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:36.759696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:36.842284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:36.843178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:36.843178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:36.868943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b74a3570eb424a930070d28a8b09e8', 'request_id': 'req-112b72c8-8389-40f0-b7cc-1743c6d27f21'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:36.872999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:36.875187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:36.880536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b74a3570eb424a930070d28a8b09e8', 'request_id': 'req-112b72c8-8389-40f0-b7cc-1743c6d27f21'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:36.894133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b74a3570eb424a930070d28a8b09e8', 'request_id': 'req-112b72c8-8389-40f0-b7cc-1743c6d27f21'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:36.921987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] The token cache is being invalidate because project 20b74a3570eb424a930070d28a8b09e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:36.922449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:36.923982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-112b72c8-8389-40f0-b7cc-1743c6d27f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:36.932816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1086/2128] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:36 2022] DELETE /identity/v3/projects/20b74a3570eb424a930070d28a8b09e8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:36.934705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1e9b-a34f-4755-9de9-92a5cc8acb51 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:36.935109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1e9b-a34f-4755-9de9-92a5cc8acb51 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:36.935734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1e9b-a34f-4755-9de9-92a5cc8acb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:36.965418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e9aa1e9b-a34f-4755-9de9-92a5cc8acb51 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:36.965418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e9aa1e9b-a34f-4755-9de9-92a5cc8acb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.011425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1043/2129] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:37.030443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.040142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.110623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1087/2130] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:37.122470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.122655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.122837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.144369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:37.145735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.156020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1088/2131] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:37.164284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.181284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd568f2f-73b3-4b3d-81e3-6d3baae7d3c8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.191357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.192638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.193122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.193579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.194529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62464b2-6217-493f-9c4e-e79893e5ae91 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.194844 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:37.195352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.198212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.207592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.209270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.209992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.211114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.221500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1089/2132] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:52:37.228489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.228832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.233215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.245712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3322396-4f9e-4130-9d88-7113a0abddb9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.252505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1044/2133] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:52:37.252836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.253512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.254062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.254709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.255807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.258754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.305270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1090/2134] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:37 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:37.310824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.342243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a799f-715f-48f0-a3f1-5bd02aa0aede service swift] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.455906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.456838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.457118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.457564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.458581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.461104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.492863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1045/2135] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:37 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:37.500969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.515154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1621d3-0d29-4634-9159-1032b52faff6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.520658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.521383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.521707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.522300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.523121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.525346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.541822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1091/2136] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:37.547143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.563700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75d1e-55ce-4c05-90e6-00a9bc183570 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.572419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.573531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.574074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.574485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.575885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.579533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee6075-008b-4879-8c9a-e0042f626e50 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.600028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1046/2137] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:37.605972 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.615694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.616210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.616717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.625399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167f875-0ffb-4a5d-8f88-165d2853f273 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.634488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.636403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.637005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.637582 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] PATH_INFO: `/v3/projects/64384c627f6d428280d1ac407e455c9d/users/b4ae166c6b4b47e294b221166c48ab06/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.650176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:37.651721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.666805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64384c627f6d428280d1ac407e455c9d, user_id=b4ae166c6b4b47e294b221166c48ab06, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:37.672834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b116-f576-4014-a0da-21f92c002919 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:37.697742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1092/2138] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:37 2022] PUT /identity/v3/projects/64384c627f6d428280d1ac407e455c9d/users/b4ae166c6b4b47e294b221166c48ab06/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:37.718211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.718668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.719229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:37.762151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1047/2139] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:37.772359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] MFA Rules not processed for user `b4ae166c6b4b47e294b221166c48ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:37.774482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.780683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.879303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282b85-44d7-4486-94d4-6b1e30c45e9d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:37.901410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1093/2140] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:37.914005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:37.915949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:37.994763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:37.996222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:37.996670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:37.997023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:38.009647 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15971d-1cee-4318-8079-88c7b4ee5304 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:38.016395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:38.017594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:38.018015 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:38.018477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:38.034663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:38.036384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc260bc-3639-4d24-91be-4f93816971f1 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:38.047069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1094/2141] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:38.089436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:38.089436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:38.099264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1048/2142] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:52:38.626003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:38.626292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:38.626967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:38.653715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:38.655897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:38.687766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1095/2143] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:38.718846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:38.738052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7946-c34a-46a6-ab61-50ea4f03400c service swift] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:38.746838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:38.747900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:38.748360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:38.748841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:38.771223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:38.777111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd45d2-a1de-4502-812c-dab0544815db service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:38.793465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1049/2144] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:52:39.248031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:39.250241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:39.343739 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3811d3-8468-4c86-baa4-bf1080b01ceb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:39.349538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:39.350661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:39.351110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:39.351480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] PATH_INFO: `/v3/users/b4aaaaf81c084d2eae21666cbc23acbc` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:39.353246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4aaaaf81c084d2eae21666cbc23acbc)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:39.355774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:39.434956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4aaaaf81c084d2eae21666cbc23acbc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:39.447492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4aaaaf81c084d2eae21666cbc23acbc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:39.460207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4aaaaf81c084d2eae21666cbc23acbc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:39.481934 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4aaaaf81c084d2eae21666cbc23acbc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:39.483364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4aaaaf81c084d2eae21666cbc23acbc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:39.499607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1096/2145] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:39 2022] DELETE /identity/v3/users/b4aaaaf81c084d2eae21666cbc23acbc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:39.502686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:39.503199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:39.503624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:39.540604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:39.543080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:39.651281 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1050/2146] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:39.666521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:39.672664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:39.797084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d455b-6b94-4d33-814d-70e9d7579f2d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:39.802553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:39.803885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:39.804378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:39.804832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:39.852158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:39.856614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398c2b-9e06-4bb3-b905-cbaf1dcdd7f5 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:39.881244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1097/2147] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:40.467259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:40.472036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:40.527537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:40.529307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:40.530130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:40.557335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8830d-d8d7-4ac0-a9e4-f28b47a48366 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:40.590432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:40.592196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:40.593630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:40.594345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] PATH_INFO: `/v3/projects/ed5331b4296843deaa95406476f1168d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:40.597755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5331b4296843deaa95406476f1168d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:40.602243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:40.603733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:40.605096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:40.621696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1098/2148] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:40.639985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:40.642438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:40.734547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5331b4296843deaa95406476f1168d', 'request_id': 'req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:40.747214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5331b4296843deaa95406476f1168d', 'request_id': 'req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:40.758867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5331b4296843deaa95406476f1168d', 'request_id': 'req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:40.779135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] The token cache is being invalidate because project ed5331b4296843deaa95406476f1168d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:40.779599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:40.781057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:40.784833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1051/2149] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:40 2022] DELETE /identity/v3/projects/ed5331b4296843deaa95406476f1168d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:40.791081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:40.793929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:40.800258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27ebf3-1284-4a6d-95da-a63b8e69e883 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:40.904656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aec9-50e1-4a71-b916-aaeec9a4c9ab admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:40.915968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:40.917631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:40.918176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:40.918684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] PATH_INFO: `/v3/users/cbfe24da92e6421f980be44df7986763` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:40.921497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfe24da92e6421f980be44df7986763)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:40.926178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:40.945306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:40.947224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:40.947224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:40.947224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:40.950309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:40.965751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:40.967893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:40.983492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1099/2150] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:41.023464 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfe24da92e6421f980be44df7986763'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.025540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfe24da92e6421f980be44df7986763'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.053675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfe24da92e6421f980be44df7986763'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.055736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfe24da92e6421f980be44df7986763'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.074360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e0198f9-df7c-417b-8123-b084b255b886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfe24da92e6421f980be44df7986763'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.117048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1052/2151] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:40 2022] DELETE /identity/v3/users/cbfe24da92e6421f980be44df7986763 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:41.520726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:41.533456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7119-ff87-4ce3-abca-02a4d1ecd3c9 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:41.636443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:41.637273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:41.637742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:41.638163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] PATH_INFO: `/v3/projects/1c2945d61584455aab973c684b107c51` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:41.640420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2945d61584455aab973c684b107c51)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:41.644033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:41.727058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2945d61584455aab973c684b107c51', 'request_id': 'req-215ecac2-92a9-4431-a446-2c31a2d1b56b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.736721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2945d61584455aab973c684b107c51', 'request_id': 'req-215ecac2-92a9-4431-a446-2c31a2d1b56b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.749586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2945d61584455aab973c684b107c51', 'request_id': 'req-215ecac2-92a9-4431-a446-2c31a2d1b56b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.770339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] The token cache is being invalidate because project 1c2945d61584455aab973c684b107c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:41.770861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.774601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-215ecac2-92a9-4431-a446-2c31a2d1b56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:41.777481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1100/2152] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:41 2022] DELETE /identity/v3/projects/1c2945d61584455aab973c684b107c51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:41.788414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:41.789032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:41.789217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:41.818607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:41.820584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:41.915077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1053/2153] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:41.928003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:41.928427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:41.928845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:41.957617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:41.959551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:41.976126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1101/2154] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:41.981480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:41.982824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:41.983807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.002039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb5be4-0255-4ddb-ab66-783c738e2e29 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.003914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823d55-aedc-484f-850f-a577ff7fdadd None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.010624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.011841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.012331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.012808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.013267 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.014314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:42.014779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.018002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.020398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.020986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.021492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] PATH_INFO: `/v3/users/da4c313808ee421b8478f298e31b7dfd` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.023243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4c313808ee421b8478f298e31b7dfd)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.026514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.048192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1102/2155] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:52:42.051528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.075766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f08ce-5181-48fa-91b7-67eb5e6daecb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.085737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.086782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.087375 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.087730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.088954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.093296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.107926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4c313808ee421b8478f298e31b7dfd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.110124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4c313808ee421b8478f298e31b7dfd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.129488 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4c313808ee421b8478f298e31b7dfd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.130859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4c313808ee421b8478f298e31b7dfd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.148506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-01cee672-57ad-4498-a362-4ef02f55329a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4c313808ee421b8478f298e31b7dfd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.150467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1103/2156] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:42.157112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.160051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.185763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1054/2157] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:41 2022] DELETE /identity/v3/users/da4c313808ee421b8478f298e31b7dfd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:42.191937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.192459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.192877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.216597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:42.218531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.292232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be637d22-7d49-448d-aead-5e1f42f5336d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.319909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1055/2158] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:42.338292 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.342350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.383115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.384505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.385031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.385543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.387062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.390746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.424537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1104/2159] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:42 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:42.427850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96125bd-7c87-4560-a07f-5bbf66c03395 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.429079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.437026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.438066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.438526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.439598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092d23-3546-4f8d-8da3-8b98608ebbfb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.441620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.446388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.447165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.447447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.447769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.448627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.450294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.462048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.466208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1105/2160] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:42.466409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.467272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.477808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a4b6-a3cd-4462-b3c7-4ca782a2e46f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.482811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.483496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.483821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.484096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.484477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1056/2161] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:42.488834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.490949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75801874-01af-4d45-af7b-1194840d2091 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.512498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1106/2162] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:52:42.518421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.532162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa4927-e336-4227-bcca-daa3afc9cd02 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.537793 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.538601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.538880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.539151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] PATH_INFO: `/v3/projects/d2320a2887e24912a348d8c98ca475a9/users/d2b620faf75f49ce8ab437af38138751/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.557459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2320a2887e24912a348d8c98ca475a9, user_id=d2b620faf75f49ce8ab437af38138751, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.560468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.577045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1057/2163] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:42 2022] PUT /identity/v3/projects/d2320a2887e24912a348d8c98ca475a9/users/d2b620faf75f49ce8ab437af38138751/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:42.589274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.589850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.590389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.632623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] MFA Rules not processed for user `d2b620faf75f49ce8ab437af38138751`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:42.634796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.711489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.713649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.735532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1107/2164] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:42.752262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:42.755130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:42.800124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71d15-9610-45e7-bf10-cc7589d4acca admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.805478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.806382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.806656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.806926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] PATH_INFO: `/v3/projects/a4692ee5d2c64ec89610944f894a1836` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.808265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4692ee5d2c64ec89610944f894a1836)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.810247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.828336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6b1d9-1432-4a89-b1af-4f78023893db None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:42.832668 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:42.833769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.834238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.834650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.847873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:42.849519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f186a-a3f9-4420-830d-1e3d506d606c service glance] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:42.863526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1108/2165] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:52:42.870708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4692ee5d2c64ec89610944f894a1836', 'request_id': 'req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.879691 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4692ee5d2c64ec89610944f894a1836', 'request_id': 'req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.888791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4692ee5d2c64ec89610944f894a1836', 'request_id': 'req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.904608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] The token cache is being invalidate because project a4692ee5d2c64ec89610944f894a1836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:42.905107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.906398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d1ec8087-f7d2-41e6-9b7d-39d07ce0711c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:42.909435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1058/2166] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:42 2022] DELETE /identity/v3/projects/a4692ee5d2c64ec89610944f894a1836 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:42.916808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:42.917160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:42.917445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:42.955215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:42.957519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:43.055227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1109/2167] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:43.064092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.064092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.064092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.086402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:43.088459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:43.098777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1059/2168] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:43.103834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.116063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f4b6f-ed5b-4175-9e83-5fcd305fe670 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.122706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.123780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.124107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.124468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.125540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:52:43.125931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.127942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.144222 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1110/2169] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:52:43.150024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.168215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11c0c-1b71-473e-b715-f09112c16ff4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.176837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.177902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.178358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.178819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.180061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.183788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.233681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1060/2170] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:43.236483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.257012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5f6e-03a4-4e10-bf89-48d3cd02754b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.370038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.371237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.371789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.372257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.373535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.377325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.412387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1111/2171] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:43 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:43.417231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.438123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bfe81-885f-4ab3-b8e5-73788d9a40bc admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.446819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.448006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.448470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.448894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.472327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.475563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.514141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1061/2172] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:43.519044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.537508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233169f-241e-410c-aa82-a67074beaf57 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.561570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.562398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.562784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.563165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.564069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.566037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a9e68-5a3b-4b64-9467-92714fffb0ac admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.598910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.599756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1112/2173] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:43.623967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c42d68-fda8-4fc1-aa25-2f035d8cb106 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.633067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.636197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.636763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.637943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] PATH_INFO: `/v3/projects/666459593d89453f9c18f63d5ad5021f/users/549954ffc4af4de0a0c680385407756a/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.669692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=666459593d89453f9c18f63d5ad5021f, user_id=549954ffc4af4de0a0c680385407756a, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:43.675337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:43.703724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1062/2174] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:43 2022] PUT /identity/v3/projects/666459593d89453f9c18f63d5ad5021f/users/549954ffc4af4de0a0c680385407756a/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:43.711255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d180e-cf07-4e50-9a55-3bb0ff1fc710 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.711942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d180e-cf07-4e50-9a55-3bb0ff1fc710 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.712247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d180e-cf07-4e50-9a55-3bb0ff1fc710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:43.735128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-257d180e-cf07-4e50-9a55-3bb0ff1fc710 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:43.736679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-257d180e-cf07-4e50-9a55-3bb0ff1fc710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:43.859119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1113/2175] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:43.877484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:43.880980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:43.984994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544cff4-4ff9-418d-86b3-4b3db041ecfa admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:43.996126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:43.997346 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:43.997855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:43.998318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:44.016436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:44.019960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:44.035845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1063/2176] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:44.875453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:44.876451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:44.877052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:44.900509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:44.902649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:44.913768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1114/2177] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:44.935454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:44.938546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:45.195591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50be4-b482-4c1e-9997-413794f98ed3 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:45.206187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:45.207249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:45.208249 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:45.208407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:45.237319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:45.241519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baadce-55c6-497d-8129-c6093bba35e1 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:45.292152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1064/2178] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:51.318473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:51.320469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:51.358029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f37e31-a9a8-430c-b2af-6f8f8642bb08 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:51.374511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:51.376058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:51.376585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:51.377096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] PATH_INFO: `/v3/users/b4ae166c6b4b47e294b221166c48ab06` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:51.379059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ae166c6b4b47e294b221166c48ab06)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:51.387978 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:51.468425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:51.469913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:51.471148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:51.509393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:51.511525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:51.533706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1065/2179] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:51.564179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:51.601107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77569c6-9ddd-426b-b6ee-a59ea361e151 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:51.616943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:51.618134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:51.618627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:51.619153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:51.626250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ae166c6b4b47e294b221166c48ab06'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:51.641538 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ae166c6b4b47e294b221166c48ab06'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:51.655649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:51.658003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ae166c6b4b47e294b221166c48ab06'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:51.659075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:51.674110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ae166c6b4b47e294b221166c48ab06'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:51.675281 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c973ba07-5c76-47fc-be60-d9ef83688b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ae166c6b4b47e294b221166c48ab06'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:51.684420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1115/2180] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:52:51 2022] DELETE /identity/v3/users/b4ae166c6b4b47e294b221166c48ab06 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:51.690387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd697-ac56-4148-bb11-c9700652c08e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:51.691073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd697-ac56-4148-bb11-c9700652c08e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:51.691720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd697-ac56-4148-bb11-c9700652c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:51.716850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1066/2181] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:51.720151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ab0bd697-ac56-4148-bb11-c9700652c08e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:51.724525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ab0bd697-ac56-4148-bb11-c9700652c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:51.887223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1116/2182] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:52:51.906347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:51.909819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:51.953217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c2292-e39d-40f9-aed9-79965172fedb service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:52.127998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:52.131969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:52.132377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:52.132767 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:52.157010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:52.159034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:52.183871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1067/2183] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:52:52.461932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:52.462604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:52.462819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:52.509626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] MFA Rules not processed for user `549954ffc4af4de0a0c680385407756a`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:52.510876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:52.633986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1117/2184] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:52:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:52.640333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:52.642557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:52.663025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd009f5-e1bc-4fbb-b0bd-f2b71d88701e service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:52.668666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:52.669431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:52.669708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:52.670133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:52.670987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:52.673819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:52.722353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1068/2185] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:52:52 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:52:52.731276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:52.754391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4287e-2d04-4c39-a4f6-6d5c9b2dbafa None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:52.810480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:52.813729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:52.934138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:52.935289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:52.935795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:52.936241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:52.937814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:52.951657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.028727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeaf20-3317-43cf-a6ed-8913d5efedda admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:53.050243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:53.060333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:53.060610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:53.061169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] PATH_INFO: `/v3/projects/64384c627f6d428280d1ac407e455c9d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:53.065655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1118/2186] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:52:52 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:52:53.065902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64384c627f6d428280d1ac407e455c9d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:53.068271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:53.069749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.106994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf26fe-319c-48ac-926e-dc3ba4bbcae2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:53.115764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:53.117080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:53.117306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:53.117807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:53.119074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:53.121565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.156022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1119/2187] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:53.165504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:53.197618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64384c627f6d428280d1ac407e455c9d', 'request_id': 'req-903d7b7d-53d1-41ce-a161-27db7730808a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:53.198402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a89924-133b-4d60-93ae-5902856845db admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:53.225050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64384c627f6d428280d1ac407e455c9d', 'request_id': 'req-903d7b7d-53d1-41ce-a161-27db7730808a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:53.250021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64384c627f6d428280d1ac407e455c9d', 'request_id': 'req-903d7b7d-53d1-41ce-a161-27db7730808a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:53.300953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] The token cache is being invalidate because project 64384c627f6d428280d1ac407e455c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:52:53.301499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:53.302916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:52:53.306537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1069/2188] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:52:52 2022] DELETE /identity/v3/projects/64384c627f6d428280d1ac407e455c9d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:52:53.371496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:53.374365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:53.375437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:53.375998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] PATH_INFO: `/v3/projects/a425fccc9f6847adbc931182a4335084/users/1a7e70467d8c49baac0e26d6ce65c8be/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:53.407297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a425fccc9f6847adbc931182a4335084, user_id=1a7e70467d8c49baac0e26d6ce65c8be, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:53.412349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.445906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1120/2189] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:53 2022] PUT /identity/v3/projects/a425fccc9f6847adbc931182a4335084/users/1a7e70467d8c49baac0e26d6ce65c8be/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:53.457617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:53.479823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:53.498838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7b7d-53d1-41ce-a161-27db7730808a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:53.639776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:53.640396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:53.641209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:53.641209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:53.641811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:53.643722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c68d-35b5-45db-b92b-b28d29cc3330 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.664075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1070/2190] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:52:53.667258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:53.686960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500bfbb-6ab9-4a66-a7cc-88cf1daf91ce admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:53.696356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:53.699396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:53.700808 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:53.701379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] PATH_INFO: `/v3/projects/a425fccc9f6847adbc931182a4335084/users/1a7e70467d8c49baac0e26d6ce65c8be/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:53.705611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a425fccc9f6847adbc931182a4335084, user_id=1a7e70467d8c49baac0e26d6ce65c8be, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:53.711211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:53.734390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1121/2191] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:52:53 2022] PUT /identity/v3/projects/a425fccc9f6847adbc931182a4335084/users/1a7e70467d8c49baac0e26d6ce65c8be/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:52:55.948015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b894-234c-4298-9155-3c460248fe0c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:55.955510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b894-234c-4298-9155-3c460248fe0c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:55.955510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b894-234c-4298-9155-3c460248fe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:55.989494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-db31b894-234c-4298-9155-3c460248fe0c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:52:55.992998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-db31b894-234c-4298-9155-3c460248fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:56.110939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1071/2192] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:52:57.006216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:52:57.011277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:52:57.238477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed241e65-75c2-4a48-806c-fae727407c69 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:52:57.249673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:52:57.250806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:52:57.253002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:52:57.253002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:52:57.326367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:52:57.329100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:52:57.361373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1122/2193] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:01.009647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027f41-8012-49d7-8c06-0e0b86cdbd2f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:01.010372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027f41-8012-49d7-8c06-0e0b86cdbd2f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:01.010926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027f41-8012-49d7-8c06-0e0b86cdbd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:01.061083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3c027f41-8012-49d7-8c06-0e0b86cdbd2f None None] MFA Rules not processed for user `1a7e70467d8c49baac0e26d6ce65c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:01.063447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3c027f41-8012-49d7-8c06-0e0b86cdbd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:01.183894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1072/2194] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:01.213079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:01.232962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c133a-71d6-43c3-ad27-a27a1edeff2e service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:01.244708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:01.246125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:01.246748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:01.247391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:01.251486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:01.369671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:01.371999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8eb5b-cb93-4f8a-b506-cc226f5f618c service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:01.388242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1123/2195] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:53:03.628943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:03.629918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:03.630484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:03.663030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] MFA Rules not processed for user `549954ffc4af4de0a0c680385407756a`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:03.665233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:03.676246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1073/2196] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:05.506989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04841e-07f5-437d-8070-db0f5b08ecfd None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:05.507612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04841e-07f5-437d-8070-db0f5b08ecfd None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:05.507612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04841e-07f5-437d-8070-db0f5b08ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:05.529131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0e04841e-07f5-437d-8070-db0f5b08ecfd None None] MFA Rules not processed for user `01ef3958566645939bc64e09f4f64950`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:05.531047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0e04841e-07f5-437d-8070-db0f5b08ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:05.602295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1124/2197] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:53:07.781765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:07.785966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:07.803583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c8e1-1fa7-40c8-b5ec-2b04acbc7d31 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:07.809054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:07.810293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:07.810717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:07.811130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] PATH_INFO: `/v3/users/d2b620faf75f49ce8ab437af38138751` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:07.813344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b620faf75f49ce8ab437af38138751)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:07.816759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:07.889651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b620faf75f49ce8ab437af38138751'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:07.892990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b620faf75f49ce8ab437af38138751'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:07.905605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b620faf75f49ce8ab437af38138751'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:07.906794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b620faf75f49ce8ab437af38138751'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:07.919550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b620faf75f49ce8ab437af38138751'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:07.954533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1074/2198] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:53:07 2022] DELETE /identity/v3/users/d2b620faf75f49ce8ab437af38138751 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:53:07.959982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:07.960873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:07.961076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:07.984115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:07.985468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:08.066499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1125/2199] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:53:08.077280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:08.078985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:08.161202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0379-518a-474e-bfe7-b53a11a98d6e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:08.167626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:08.168784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.169247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.169722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.185107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:08.186864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6840277-c2cd-4010-8b91-54d774b195fe service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:08.197977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1075/2200] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:08.537248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:08.539566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:08.565098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9e79-6c53-4a1e-be7c-174c5b63b64a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:08.573048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:08.574306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.574782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.575263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] PATH_INFO: `/v3/projects/d2320a2887e24912a348d8c98ca475a9` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.577562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2320a2887e24912a348d8c98ca475a9)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:08.579916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:08.645215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2320a2887e24912a348d8c98ca475a9', 'request_id': 'req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:08.656226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2320a2887e24912a348d8c98ca475a9', 'request_id': 'req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:08.668208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2320a2887e24912a348d8c98ca475a9', 'request_id': 'req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:08.680088 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] The token cache is being invalidate because project d2320a2887e24912a348d8c98ca475a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:53:08.680403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:08.681043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7df9e35e-a6c9-45ce-8b3e-87fc3b12242f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:08.682690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1126/2201] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:53:08 2022] DELETE /identity/v3/projects/d2320a2887e24912a348d8c98ca475a9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:53:08.689176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.689452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.689731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.710294 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:08.711816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:08.805790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1076/2202] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:08.815425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be790f-443c-4552-b31e-030c78156dad None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.815724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be790f-443c-4552-b31e-030c78156dad None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.816079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be790f-443c-4552-b31e-030c78156dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.836719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c4be790f-443c-4552-b31e-030c78156dad None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:08.837927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c4be790f-443c-4552-b31e-030c78156dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:08.846600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1127/2203] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:08.851373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:08.862017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec94f5-cb08-43c5-93d5-14af253c00e4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:08.867227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:08.867937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.868213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.868476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.869205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:53:08.869550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:08.871369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:08.886476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1077/2204] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:53:08.891044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be790f-443c-4552-b31e-030c78156dad None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:08.904102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be790f-443c-4552-b31e-030c78156dad None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:08.911648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:08.912526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:08.912951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:08.913359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:08.914548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:08.917328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:08.953856 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1128/2205] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:53:08 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:53:08.959201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:08.976878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034372-ea85-4752-b836-bc98cf66bff5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:09.052930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:09.053965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.054435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.054891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.056260 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:09.058642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:09.089662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:09.095536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1078/2206] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:53:08 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:53:09.101400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584b6a-2e0e-4940-913f-8d18d5eee856 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:09.107333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:09.108180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.108555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.109196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.110038 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:09.112348 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:09.125254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1129/2207] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:53:09.129716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:09.142157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5fc14-d05c-432d-9a75-0dbb0e4b70bd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:09.149682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:09.150452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.150833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.151205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.152086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:09.154034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c7392-c749-46b3-9cab-0ac084049538 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:09.168056 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1079/2208] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:53:09.172540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:09.184271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70af3-b569-42f0-b690-71c83e7a8621 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:09.190244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:09.191132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.191895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.192171 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] PATH_INFO: `/v3/projects/16c699181aca414a96abd588acf32d02/users/ada86ca7b285456e89782d3ae9095b66/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.218081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c699181aca414a96abd588acf32d02, user_id=ada86ca7b285456e89782d3ae9095b66, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:09.220841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:09.238710 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1130/2209] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:53:09 2022] PUT /identity/v3/projects/16c699181aca414a96abd588acf32d02/users/ada86ca7b285456e89782d3ae9095b66/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:53:09.250160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d746be-e63b-4ca3-aa45-e6e42694eff3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.250646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d746be-e63b-4ca3-aa45-e6e42694eff3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.251095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d746be-e63b-4ca3-aa45-e6e42694eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.288978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-24d746be-e63b-4ca3-aa45-e6e42694eff3 None None] MFA Rules not processed for user `ada86ca7b285456e89782d3ae9095b66`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:09.290564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-24d746be-e63b-4ca3-aa45-e6e42694eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:09.381759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1080/2210] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:09.394066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:09.396143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:09.494839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21047919-280a-4c1a-8260-adbd1973c398 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:09.499111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:09.499821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:09.500170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:09.500374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:09.514219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:09.515817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:09.526216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1131/2211] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:16.640936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18385-e691-407b-a8fc-cf1f56c6d2ae None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:16.641433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18385-e691-407b-a8fc-cf1f56c6d2ae None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:16.641552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18385-e691-407b-a8fc-cf1f56c6d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:16.660649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0cf18385-e691-407b-a8fc-cf1f56c6d2ae None None] MFA Rules not processed for user `e1a1ebc97cfb49d3af0fc95157482c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:16.661879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0cf18385-e691-407b-a8fc-cf1f56c6d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:16.733018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1081/2212] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:53:28.675638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:28.677274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:28.807604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c9e3-f6c4-4ea1-9e1b-a9b14adca437 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:28.820422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:28.821116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:28.821429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:28.822733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:28.824750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:28.837875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:28.839558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:28.857853 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1132/2213] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:43.677083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e91c-5ce8-4ae5-aad3-a3fcadde5bab None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:43.678497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e91c-5ce8-4ae5-aad3-a3fcadde5bab None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:43.679230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e91c-5ce8-4ae5-aad3-a3fcadde5bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:43.719554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0229e91c-5ce8-4ae5-aad3-a3fcadde5bab None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:43.722482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0229e91c-5ce8-4ae5-aad3-a3fcadde5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:43.841592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1082/2214] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:53:43.866466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:43.874345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:44.042644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2831e-1a67-44e0-8b40-6da6f138c4c8 service placement] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:44.058599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:44.059794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:44.060086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:44.060393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:44.071436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:44.073178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:44.088053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1133/2215] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:45.002828 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256394c-d5f8-4126-90c1-b4bbab91729a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:45.003443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256394c-d5f8-4126-90c1-b4bbab91729a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:45.003443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256394c-d5f8-4126-90c1-b4bbab91729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:45.031471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9256394c-d5f8-4126-90c1-b4bbab91729a None None] MFA Rules not processed for user `a440a1183fca4565a84e009d99acf813`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:45.033074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9256394c-d5f8-4126-90c1-b4bbab91729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:45.108815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1083/2216] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:47.251395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:47.253119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:47.348035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f128b-5776-4716-a51d-2b827ff25909 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:47.358329 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:47.359572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:47.360154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:47.360520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:47.362826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:47.458767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:47.461787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:47.477470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1134/2217] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:49.095461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:49.096018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:49.096201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:49.135151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:49.136769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:49.148783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1084/2218] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:49.169791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:49.185531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd4577-7855-484c-8b58-65db43bca2f7 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:49.195626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:49.197136 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:49.197920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:49.198355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:49.225920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:49.228370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962977b-8608-4e87-9355-77359f1d630c service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:49.239732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1135/2219] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:49.365027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:49.377280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147da74-e24a-472e-abd1-b7a2ddcca616 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:49.383408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:49.384345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:49.384628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:49.384902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] PATH_INFO: `/v3/users/ada86ca7b285456e89782d3ae9095b66` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:49.386140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada86ca7b285456e89782d3ae9095b66)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:49.388187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:49.451407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada86ca7b285456e89782d3ae9095b66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:49.452194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada86ca7b285456e89782d3ae9095b66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:49.462326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada86ca7b285456e89782d3ae9095b66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:49.463065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada86ca7b285456e89782d3ae9095b66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:49.473030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada86ca7b285456e89782d3ae9095b66'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:49.503303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1085/2220] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:53:49 2022] DELETE /identity/v3/users/ada86ca7b285456e89782d3ae9095b66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:53:49.508349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:49.508689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:49.509022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:49.531063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:49.532641 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:49.612606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1136/2221] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:49.629084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:49.631628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:49.707024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836147-5c18-40c3-ac9d-a5c88d49629f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:49.711326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:49.712042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:49.712323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:49.712581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:49.723928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:49.725502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56047c-22d6-476f-a28c-41c30b033ef8 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:49.737116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1086/2222] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:50.419370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:50.423079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:50.443182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64c91-6cf2-475c-90bc-f0b3f9546561 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:50.449720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:50.450933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:50.451378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:50.451935 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] PATH_INFO: `/v3/projects/16c699181aca414a96abd588acf32d02` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:50.453469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c699181aca414a96abd588acf32d02)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:50.456336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:50.558806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c699181aca414a96abd588acf32d02', 'request_id': 'req-7b2e47f3-0156-4f4a-9d3d-e6c616226119'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:50.566903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c699181aca414a96abd588acf32d02', 'request_id': 'req-7b2e47f3-0156-4f4a-9d3d-e6c616226119'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:50.576863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c699181aca414a96abd588acf32d02', 'request_id': 'req-7b2e47f3-0156-4f4a-9d3d-e6c616226119'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:50.591715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] The token cache is being invalidate because project 16c699181aca414a96abd588acf32d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:53:50.592025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:50.592778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:53:50.594801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1137/2223] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:53:50 2022] DELETE /identity/v3/projects/16c699181aca414a96abd588acf32d02 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:53:53.219853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee361-97b7-4777-bd5a-d3d840d7fd12 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:53.220368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee361-97b7-4777-bd5a-d3d840d7fd12 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:53.220533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee361-97b7-4777-bd5a-d3d840d7fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:53.239218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-869ee361-97b7-4777-bd5a-d3d840d7fd12 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:53.240547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-869ee361-97b7-4777-bd5a-d3d840d7fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:53.306025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1087/2224] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:53.324823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:53.326665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:53.407117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e47f3-0156-4f4a-9d3d-e6c616226119 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:53.413046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:53.413718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:53.414108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:53.414285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:53.422904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:53.424606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:53.434851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1138/2225] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:53:59.468571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bafa-9835-4d18-8345-a19dea95e7c4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:59.469125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bafa-9835-4d18-8345-a19dea95e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:59.469125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bafa-9835-4d18-8345-a19dea95e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:59.488065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-10d5bafa-9835-4d18-8345-a19dea95e7c4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:53:59.489359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-10d5bafa-9835-4d18-8345-a19dea95e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:53:59.497592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1088/2226] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:53:59.515008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:53:59.527157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959f59a-1bf5-4f93-8a49-ee47b3954d68 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:53:59.533276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:53:59.533959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:53:59.534238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:53:59.534518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:53:59.543241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:53:59.544872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:53:59.557130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1139/2227] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:05.778070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfbf8-3276-4583-bb7d-5b5b35a19c05 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:05.778674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfbf8-3276-4583-bb7d-5b5b35a19c05 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:05.779014 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfbf8-3276-4583-bb7d-5b5b35a19c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:05.799716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dc0bfbf8-3276-4583-bb7d-5b5b35a19c05 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:05.800860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dc0bfbf8-3276-4583-bb7d-5b5b35a19c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:05.808934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1089/2228] 10.222.0.43 () {58 vars in 1016 bytes} [Wed May 4 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:54:05.835704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:05.837504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:05.858527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e25e3-f9f4-4e09-a5ff-29e9347f6095 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:05.865455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:05.866218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:05.866489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:05.866767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:05.876662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:05.878464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:05.890135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1140/2229] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:11.646543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97a1d-d51a-429d-bb8e-48fc3024e76f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:11.647180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97a1d-d51a-429d-bb8e-48fc3024e76f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:11.647180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97a1d-d51a-429d-bb8e-48fc3024e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:11.704139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a5a97a1d-d51a-429d-bb8e-48fc3024e76f None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:11.705470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a5a97a1d-d51a-429d-bb8e-48fc3024e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:11.790656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1090/2230] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:11.851245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:11.852662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:11.969923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edd6c-d996-4fed-8a94-773eb9c607e5 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:11.977011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:11.977650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:11.977927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:11.978236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:11.992512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:11.994479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063e274-128d-4d2b-b534-dadc92f693fe service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:12.006207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1141/2231] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:54:29.665198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:29.665874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:29.665874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:29.667255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1091/2232] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:54:29.673846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e619-c3d4-4a93-a28d-e66ffee03af5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:29.674438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e619-c3d4-4a93-a28d-e66ffee03af5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:29.674438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e619-c3d4-4a93-a28d-e66ffee03af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:29.715133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c403e619-c3d4-4a93-a28d-e66ffee03af5 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:29.716462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c403e619-c3d4-4a93-a28d-e66ffee03af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:29.727025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1142/2233] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:29.741818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:29.744834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:29.836764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8190c6-a918-4aa7-9d93-f2ab1bff8eb7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:29.840529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:29.841183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:29.841463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:29.841732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:29.852619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:29.854123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03bedb-022c-4255-8a19-41382d055ca2 service glance] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:29.865105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1092/2234] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:29.942289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:29.942584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:29.942971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:29.944743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1143/2235] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:54:29.949756 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e981f0-14bd-4b35-9c58-9354532f7148 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:29.950041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e981f0-14bd-4b35-9c58-9354532f7148 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:29.950324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e981f0-14bd-4b35-9c58-9354532f7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:29.969353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-36e981f0-14bd-4b35-9c58-9354532f7148 None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:29.970542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-36e981f0-14bd-4b35-9c58-9354532f7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:30.038200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1093/2236] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:30.050746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:30.052683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:30.068144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4e46-4058-4050-94ff-6fbdb0d210af None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:30.072144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:30.073131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:30.073131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:30.073514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:30.081714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:30.083094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30665d57-e900-4652-bc1b-aae8dc104179 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:30.091656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1144/2237] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:30.180405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f68d-1c27-4917-8e71-bd43a74999a8 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:30.180646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f68d-1c27-4917-8e71-bd43a74999a8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:30.180956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f68d-1c27-4917-8e71-bd43a74999a8 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:30.182331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1094/2238] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:54:30.189065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830192-d14a-4510-8ba7-55b004f5e377 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:30.189546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830192-d14a-4510-8ba7-55b004f5e377 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:30.189858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830192-d14a-4510-8ba7-55b004f5e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:30.208942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-82830192-d14a-4510-8ba7-55b004f5e377 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:30.210063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-82830192-d14a-4510-8ba7-55b004f5e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:30.222959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1145/2239] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:54:30.234041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f68d-1c27-4917-8e71-bd43a74999a8 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:30.246027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f68d-1c27-4917-8e71-bd43a74999a8 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:30.249987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:30.250633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:30.250915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:30.251190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:30.262264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:30.263896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:30.275853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1095/2240] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:32.645526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:32.646091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:32.646091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:32.671220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:32.673854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:32.683205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1146/2241] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:32.697682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:32.714307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73530484-3d03-4897-9a28-4ce3875b90d3 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:32.721131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:32.721796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:32.722078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:32.722350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:32.732454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:32.734110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:32.743074 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1096/2242] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:54:44.229686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:44.233160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:44.259957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09bf9-646c-4c5b-8251-0553c3655098 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:44.267750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:44.269293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:44.269772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:44.270288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] PATH_INFO: `/v3/users/e1a1ebc97cfb49d3af0fc95157482c5a` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:44.271852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a1ebc97cfb49d3af0fc95157482c5a)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:44.274794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:44.351504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a1ebc97cfb49d3af0fc95157482c5a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.361926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a1ebc97cfb49d3af0fc95157482c5a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.371594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a1ebc97cfb49d3af0fc95157482c5a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.390832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a1ebc97cfb49d3af0fc95157482c5a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.391559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9bbe0628-7418-4d8a-906b-124f72d7644d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a1ebc97cfb49d3af0fc95157482c5a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.403248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1147/2243] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:54:44 2022] DELETE /identity/v3/users/e1a1ebc97cfb49d3af0fc95157482c5a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:54:44.599298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:44.617062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cb638-ca7e-46d6-ace9-21f3fa0f73e0 service swift] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:44.708964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:44.710588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:44.711073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:44.711574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] PATH_INFO: `/v3/projects/87e91a88fb3b450cbd8cf8794ca426ee` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:44.714068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e91a88fb3b450cbd8cf8794ca426ee)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:44.718099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:44.800627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e91a88fb3b450cbd8cf8794ca426ee', 'request_id': 'req-6dd31e83-a090-4834-b804-f21cf0a1697d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.811252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e91a88fb3b450cbd8cf8794ca426ee', 'request_id': 'req-6dd31e83-a090-4834-b804-f21cf0a1697d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.828069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e91a88fb3b450cbd8cf8794ca426ee', 'request_id': 'req-6dd31e83-a090-4834-b804-f21cf0a1697d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.844413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] The token cache is being invalidate because project 87e91a88fb3b450cbd8cf8794ca426ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:54:44.844825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.845599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-6dd31e83-a090-4834-b804-f21cf0a1697d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:44.847355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1097/2244] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:54:44 2022] DELETE /identity/v3/projects/87e91a88fb3b450cbd8cf8794ca426ee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:54:44.853226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:44.853540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:44.853817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:44.875063 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:44.876381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:44.947928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1148/2245] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:44.956269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:44.956695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:44.957005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:44.977232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:44.978502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:44.987403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1098/2246] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:44.992233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.002651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888e2d-f702-4bb6-aa76-34cf9cc7c604 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.007945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.008609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.008901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.009174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.009983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:54:45.010287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.012048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.025531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1149/2247] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:54:45.030248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.040626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e824-ac66-41b4-8d2d-5f188baba373 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.046676 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.047540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.047966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.048375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.049128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.051418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.081671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1099/2248] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:54:45 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:54:45.086720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.104614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc387e1-5bad-4cf3-b718-bec13e4dc201 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.179277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.180091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.180383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.180729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.181437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.183490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.206987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1150/2249] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:54:45 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:54:45.211534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.222858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd3b5-f911-4cd3-a7b6-9a3c83616637 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.228611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.229295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.229572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.229840 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.230622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.232333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.245778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1100/2250] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:54:45.250113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.261669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d6bf-7936-4626-9305-6215bbca3557 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.268223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.269174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.269592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.270018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.271012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.273429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2411e96-9736-4f80-b36a-cdcdbb200d37 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.285728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1151/2251] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:54:45.291211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.302834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e64bd-9f74-455d-bf41-b072911d67ea admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.308047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.309227 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.309523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.309765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] PATH_INFO: `/v3/projects/27e9961d0d324b4fa5f161b43e098120/users/849affff8c1a47938da2cb4d112b9b37/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.329398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e9961d0d324b4fa5f161b43e098120, user_id=849affff8c1a47938da2cb4d112b9b37, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.332492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.348392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1101/2252] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:54:45 2022] PUT /identity/v3/projects/27e9961d0d324b4fa5f161b43e098120/users/849affff8c1a47938da2cb4d112b9b37/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:54:45.359422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe531-a049-404d-862b-534b2b715588 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.359747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe531-a049-404d-862b-534b2b715588 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.360036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe531-a049-404d-862b-534b2b715588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.392765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-aefbe531-a049-404d-862b-534b2b715588 None None] MFA Rules not processed for user `849affff8c1a47938da2cb4d112b9b37`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:45.394000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-aefbe531-a049-404d-862b-534b2b715588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:45.471104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1152/2253] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:54:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:45.486326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:45.488549 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:45.577039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0e32-9aa7-46fa-8d79-0327e82a79ae admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:45.581667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:45.582541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:45.582945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:45.583348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:45.593141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:45.594617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151cd10-fdde-4a68-b5cd-3f478e4ba699 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:45.606132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1102/2254] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:55.938946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe531-a049-404d-862b-534b2b715588 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:56.027051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe531-a049-404d-862b-534b2b715588 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:56.032578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:56.033632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:56.034041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:56.034510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] PATH_INFO: `/v3/users/849affff8c1a47938da2cb4d112b9b37` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:56.036158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849affff8c1a47938da2cb4d112b9b37)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:56.038912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:56.106219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849affff8c1a47938da2cb4d112b9b37'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.118900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849affff8c1a47938da2cb4d112b9b37'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.129477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849affff8c1a47938da2cb4d112b9b37'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.145455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849affff8c1a47938da2cb4d112b9b37'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.146355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849affff8c1a47938da2cb4d112b9b37'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.153444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1153/2255] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:54:55 2022] DELETE /identity/v3/users/849affff8c1a47938da2cb4d112b9b37 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:54:56.158551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:56.159187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:56.159187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:56.177855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:56.179152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:56.249484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1103/2256] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:56.261357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:56.262965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:56.352478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26baca-921f-4701-af49-0525ecac4760 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:56.357700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:56.358762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:56.359143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:56.359520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:56.372196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:56.374067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a19b1-4131-418a-8355-4f275e00ac79 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:56.387592 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1154/2257] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:54:56.794746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:56.797145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:56.818552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50dac-883b-4b6c-8ec3-24150ba34a73 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:56.828401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:56.829929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:56.830314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:56.830808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] PATH_INFO: `/v3/projects/27e9961d0d324b4fa5f161b43e098120` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:56.833122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e9961d0d324b4fa5f161b43e098120)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:56.836764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:56.908836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e9961d0d324b4fa5f161b43e098120', 'request_id': 'req-b97ba4dc-8914-4620-a8b9-b4571f109254'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.919552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e9961d0d324b4fa5f161b43e098120', 'request_id': 'req-b97ba4dc-8914-4620-a8b9-b4571f109254'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.930164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e9961d0d324b4fa5f161b43e098120', 'request_id': 'req-b97ba4dc-8914-4620-a8b9-b4571f109254'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.945695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] The token cache is being invalidate because project 27e9961d0d324b4fa5f161b43e098120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:54:56.946075 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.946783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:54:56.949620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1104/2258] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:54:56 2022] DELETE /identity/v3/projects/27e9961d0d324b4fa5f161b43e098120 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:54:57.911754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:57.912398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:57.912534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:57.933152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:54:57.934536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:58.010571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1155/2259] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:54:58.024543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:54:58.026134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:54:58.110298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba4dc-8914-4620-a8b9-b4571f109254 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:54:58.116319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:54:58.117065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:54:58.117350 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:54:58.117621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:54:58.127847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:54:58.129648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:54:58.139049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1105/2260] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:55:32.014511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:32.016280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:32.081794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a5d7c-b10d-4993-ace8-21f541bda0d0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:32.086206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:32.086877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:32.087162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:32.087474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:32.090104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:32.177707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:32.179954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a914-19d9-44f3-91f4-e61998534d3f service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:55:32.194077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1156/2261] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:55:33.389101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:33.401362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549823a2-76d9-407f-9090-a9290abf3656 service swift] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:33.406129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:33.406861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:33.407174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:33.407937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:33.413701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:33.430946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:33.432693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:55:33.445518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1106/2262] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:55:33.591312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:33.591971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:33.591971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:33.612344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] MFA Rules not processed for user `01ef3958566645939bc64e09f4f64950`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:55:33.613625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:33.677251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1157/2263] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:55:53.508639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:53.510135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:53.590390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3a-463d-4dc8-9866-eecb31d37099 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:53.598183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:53.599218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:53.599787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:53.600609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:53.603768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:53.689984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:53.691577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:55:53.707042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1107/2264] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:55:58.129009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:58.130879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:58.153289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46ddc6-2158-4e7e-813e-c2d2274ece9d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:58.161684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:58.162263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:58.162530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:58.163027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:58.165649 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:58.184430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:58.186497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:55:58.199234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1158/2265] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:55:58.695468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:58.700047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:58.730948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9d77-64a9-42c1-9f2d-7fcd616d5c96 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:58.739084 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:58.740905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:58.741582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:58.742066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:58.747529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:58.781218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:58.784140 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1bb73-54f6-42c5-bf18-5677e30f1ba8 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:55:58.807878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1108/2266] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:55:59.892146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:55:59.905006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa072c-332a-4cbe-8b22-694c41599a8f service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:55:59.912475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:55:59.913289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:55:59.913573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:55:59.913852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:55:59.916133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:55:59.992255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:55:59.994048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:00.004957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1159/2267] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:55:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:01.357106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:01.357597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:01.357689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:01.376337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] MFA Rules not processed for user `a440a1183fca4565a84e009d99acf813`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:56:01.377544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:01.384616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1109/2268] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:56:01.694928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:01.705958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b93f-b239-4f86-826b-773994945c42 service nova] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:01.710511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:01.711163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:01.711447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:01.711872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:01.714133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:01.725098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:01.726566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:01.735360 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1160/2269] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:02.064667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:02.066590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:02.143114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4030a2d-760c-427b-96bf-ea87715c68dd None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:02.148901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:02.149606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:02.149888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:02.150160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:02.152112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:02.164823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:02.166585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:02.176981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1110/2270] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:07.224576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:07.226104 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:07.242636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a0b1-39f3-4b2f-9778-7464867c789f service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:07.248994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:07.249596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:07.249912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:07.250179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:07.252525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:07.328188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:07.329843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0b68c-b06c-4eac-ac4f-0dd3e12f559f service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:07.340291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1161/2271] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:11.737177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:11.750830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce394cd-e712-4c72-af7b-d74dbe1f6274 service placement] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:11.756802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:11.757588 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:11.757960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:11.758325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:11.760970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:11.774457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:11.776125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:11.787487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1111/2272] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:16.080140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:16.080703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:16.080703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:16.098363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] MFA Rules not processed for user `f0fc4ec8d3884e679cf6fe690a191b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:56:16.099621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:16.106640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1162/2273] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:56:16.653169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:16.665152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf66a-8e05-4be0-92e4-df30ae083045 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:16.671069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:16.671775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:16.672057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:16.672332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:16.674357 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:16.687224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:16.688910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:16.701637 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1112/2274] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:16.774633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:16.784436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768863f0-87c5-42b9-a12f-0011943b8378 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:16.787944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:16.788596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:16.788872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:16.789142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:16.790953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:16.801908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:16.803777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:16.812430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1163/2275] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:37.698256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:37.708848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8303050-1a0b-4d16-a5d9-8c8cc8a5f603 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:37.713395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:37.714053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:37.714337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:37.714629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:37.716621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:37.728997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:37.730537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fae8e-326d-46a6-8a52-b6424e619844 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:37.740850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1113/2276] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:57.887725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:57.898915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9774-a18b-4841-8d77-24a1f0710efb service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:57.903232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:57.903893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:57.904262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:57.904460 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:57.906549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:57.993638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:57.995216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aac93-5909-42b2-bc5b-9f98c151cd5e service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:58.006878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1164/2277] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:58.101663 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bd8e-8698-4671-ad9d-bfb47c315308 None None] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.102255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bd8e-8698-4671-ad9d-bfb47c315308 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.102629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bd8e-8698-4671-ad9d-bfb47c315308 None None] PATH_INFO: `/` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.104247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1114/2278] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:56:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:56:58.110723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4992-a3ff-4edf-99dd-ca651a163634 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.111102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4992-a3ff-4edf-99dd-ca651a163634 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.111441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4992-a3ff-4edf-99dd-ca651a163634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.132401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5deb4992-a3ff-4edf-99dd-ca651a163634 None None] MFA Rules not processed for user `735bc87032af455c8900fafe88496ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:56:58.133730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5deb4992-a3ff-4edf-99dd-ca651a163634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:58.141366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1165/2279] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:56:58.159287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412bd8e-8698-4671-ad9d-bfb47c315308 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:58.171312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412bd8e-8698-4671-ad9d-bfb47c315308 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:58.175228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:58.176178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.176650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.177127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.185500 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:58.187323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8514f-b25d-4745-a6cd-a0afcbfeaee7 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:58.196668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1115/2280] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:56:58.302366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac0c-751c-45fb-8b06-94a0d51dd183 None None] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.302660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac0c-751c-45fb-8b06-94a0d51dd183 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.302923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac0c-751c-45fb-8b06-94a0d51dd183 None None] PATH_INFO: `/` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.304332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1166/2281] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 14:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:56:58.310093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.310402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.310673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.343798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] MFA Rules not processed for user `d9052eeac18b49d79f81f1a3ec919c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:56:58.345025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:56:58.355572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1116/2282] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:56:58.366879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ac0c-751c-45fb-8b06-94a0d51dd183 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:56:58.388365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ac0c-751c-45fb-8b06-94a0d51dd183 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:56:58.393225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:56:58.393910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:56:58.394221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:56:58.394410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:56:58.407846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:56:58.409295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:56:58.420977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1167/2283] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:57:01.717404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:01.718888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:01.734601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de9b3-1e73-4892-8be7-f7bcac891544 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:01.739752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:01.740740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:01.741083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:01.741424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] PATH_INFO: `/v3/users/01ef3958566645939bc64e09f4f64950` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:01.742651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ef3958566645939bc64e09f4f64950)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:01.744916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:01.798434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ef3958566645939bc64e09f4f64950'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:01.799101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ef3958566645939bc64e09f4f64950'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:01.806871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ef3958566645939bc64e09f4f64950'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:01.808216 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ef3958566645939bc64e09f4f64950'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:01.817282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c5c7c9f-55a8-4f3a-8b61-dac7a8cd98df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ef3958566645939bc64e09f4f64950'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:01.836471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1117/2284] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:01 2022] DELETE /identity/v3/users/01ef3958566645939bc64e09f4f64950 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:02.044693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.058833 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d4b-2b47-4457-a1fa-dc7d90aba50d service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.122597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.123474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.123771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.124045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] PATH_INFO: `/v3/projects/9b4c42db32484b47a7a01692da653e2f` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.125273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4c42db32484b47a7a01692da653e2f)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.127228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.184301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4c42db32484b47a7a01692da653e2f', 'request_id': 'req-7ff17ce0-653a-41a0-bde9-1d3259ad1420'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:02.190684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4c42db32484b47a7a01692da653e2f', 'request_id': 'req-7ff17ce0-653a-41a0-bde9-1d3259ad1420'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:02.198927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4c42db32484b47a7a01692da653e2f', 'request_id': 'req-7ff17ce0-653a-41a0-bde9-1d3259ad1420'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:02.209714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] The token cache is being invalidate because project 9b4c42db32484b47a7a01692da653e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:02.210003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:02.210724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7ff17ce0-653a-41a0-bde9-1d3259ad1420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:02.212461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1168/2285] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:02 2022] DELETE /identity/v3/projects/9b4c42db32484b47a7a01692da653e2f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:02.217850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.218138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.218406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.237953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:02.239152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:02.315379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1118/2286] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:02.323576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.323938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.324134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.343898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:02.345114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:02.353664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1169/2287] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:02.358081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.368204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7daeee-0d66-4716-bc46-554120d2b12e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.373875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.374529 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.374806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.375120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.375916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:02.376221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.377848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.389256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1119/2288] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:02.394091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.406505 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5ed2d-a27b-497e-afc8-169bbaae4128 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.412929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.413603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.413883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.414154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.414845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.416805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.459437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1170/2289] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:02 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:02.460827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.471069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ba9a-843d-47fd-abfe-47733d552d8b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.533384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.534070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.534323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.534686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.535544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.538369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.560504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1120/2290] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:02 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:02.566222 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.578604 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15204-2bb5-406b-8372-b7babb4a528c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.586722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.587393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.587696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.587968 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.588701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.590298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.602535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1171/2291] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:57:02.608521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.624091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c14fc-c7b5-46c7-8079-be2e8e50fa10 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.630078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.630731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.630981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.631278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.632036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.633671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d0ec-5ede-4200-b2f0-e07b726d0ecb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.644579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1121/2292] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:02.649294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.659474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b7815-b977-47c2-9fc9-49a1105f14c6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.664558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.665431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.665718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.665975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] PATH_INFO: `/v3/projects/0bb0a5ecd9944eaaaf49492cf3a2d81b/users/ab3a5812b8bf462b88b71367eb5af768/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.680723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb0a5ecd9944eaaaf49492cf3a2d81b, user_id=ab3a5812b8bf462b88b71367eb5af768, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.683444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.698183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1172/2293] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:02 2022] PUT /identity/v3/projects/0bb0a5ecd9944eaaaf49492cf3a2d81b/users/ab3a5812b8bf462b88b71367eb5af768/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:02.708512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.708823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.709090 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.735408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] MFA Rules not processed for user `ab3a5812b8bf462b88b71367eb5af768`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:02.736648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:02.802530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1122/2294] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:02.814448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:02.816511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:02.899701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab1288-d26d-4381-84b1-09b456dc2c4c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:02.909760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:02.910487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:02.910785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:02.911040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:02.920242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:02.921834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7817f5-2e65-4812-9957-ec260e0449e5 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:02.931072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1173/2295] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:03.121418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:03.185302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3e08-8264-49d7-9b74-5ea8020da627 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:03.190279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:03.191236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:03.191714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:03.192081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] PATH_INFO: `/v3/users/ab3a5812b8bf462b88b71367eb5af768` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:03.193349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3a5812b8bf462b88b71367eb5af768)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:03.195506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:03.249806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3a5812b8bf462b88b71367eb5af768'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.250559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3a5812b8bf462b88b71367eb5af768'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.258212 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3a5812b8bf462b88b71367eb5af768'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.259030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3a5812b8bf462b88b71367eb5af768'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.269475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3a5812b8bf462b88b71367eb5af768'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.288874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1123/2296] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:03 2022] DELETE /identity/v3/users/ab3a5812b8bf462b88b71367eb5af768 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:03.293682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:03.294226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:03.294226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:03.319630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:03.321790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:03.408895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1174/2297] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:03.426859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:03.428398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:03.486008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cc389-0fd1-449c-bb1b-47eca8fcdab2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:03.490838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:03.491483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:03.491785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:03.492048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:03.502467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:03.503969 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf9cd1-f60e-48db-80f3-6ca688f0b363 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:03.513908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1124/2298] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:03.798589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:03.800765 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:03.813839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1e71-99ee-48ee-89a3-b137a7d24231 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:03.818879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:03.819825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:03.820108 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:03.820381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] PATH_INFO: `/v3/projects/0bb0a5ecd9944eaaaf49492cf3a2d81b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:03.821673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb0a5ecd9944eaaaf49492cf3a2d81b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:03.823616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:03.880020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb0a5ecd9944eaaaf49492cf3a2d81b', 'request_id': 'req-58116ac4-750d-469d-9062-17a123ed115c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.886474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb0a5ecd9944eaaaf49492cf3a2d81b', 'request_id': 'req-58116ac4-750d-469d-9062-17a123ed115c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.896005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb0a5ecd9944eaaaf49492cf3a2d81b', 'request_id': 'req-58116ac4-750d-469d-9062-17a123ed115c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.912001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] The token cache is being invalidate because project 0bb0a5ecd9944eaaaf49492cf3a2d81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:03.912300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.913096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-58116ac4-750d-469d-9062-17a123ed115c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:03.914815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1175/2299] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:03 2022] DELETE /identity/v3/projects/0bb0a5ecd9944eaaaf49492cf3a2d81b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:03.920259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:03.920782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:03.920930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:03.941716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:03.942970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:04.008900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1125/2300] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:04.017165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.017453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.017723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.036540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:04.037711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:04.046142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1176/2301] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:57:04.050569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.061172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343064ed-f21a-466b-abf6-18d8f49cd701 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.065827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.066518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.066804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.067069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.067848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:04.068157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.069821 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.081901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1126/2302] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:04.086595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.096273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65bce2-a988-45da-aa81-499a88274b4a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.101732 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.102370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.102692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.102933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.103632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.105785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.135716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1177/2303] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:04.140195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.151042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38bca-8382-4772-991d-1e1c1833100e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.213045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.213722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.213995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.214279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.215226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.217037 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.238699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1127/2304] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:04.243087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.258075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fb9b4-852f-4dc6-88cc-7ae970b22140 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.263515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.264211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.264504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.264771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.265506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.267133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.281188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1178/2305] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:04.285330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.296777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4c77-0933-4b2f-8d80-193aa3ff0791 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.302440 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.303276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.303436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.303746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.304496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.306170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db206cd-2c63-49e6-a74d-c5ed06d543b7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.317715 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1128/2306] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:04.322384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.342570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ee8b5-df4d-4253-973f-c81dcb5456a0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.350022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.351028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.351482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.351987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] PATH_INFO: `/v3/projects/873557e0180c4f7d848a326837579af4/users/b31558d5bf7942b9be102dee47ff9edd/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.369147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] RBAC: Authorizing `identity:create_grant(project_id=873557e0180c4f7d848a326837579af4, user_id=b31558d5bf7942b9be102dee47ff9edd, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.372234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.389109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1179/2307] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:04 2022] PUT /identity/v3/projects/873557e0180c4f7d848a326837579af4/users/b31558d5bf7942b9be102dee47ff9edd/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:04.401516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.401802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.402071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.430251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] MFA Rules not processed for user `b31558d5bf7942b9be102dee47ff9edd`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:04.431489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:04.501317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1129/2308] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:04.506051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.573885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6693-b16b-4867-8600-67fc621e636b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.579523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.580390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.580672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.580943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.581671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.583644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.613637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1180/2309] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/projects => generated 357 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:04.617495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.629753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054773a6-b02f-490d-8504-dd2a97b7e86e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.689576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.690256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.690532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.690804 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.691497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.693682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.714856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1130/2310] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:04.719007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.729964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba77b-00f9-4812-bb7a-93e227eaac67 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.735625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.736272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.736539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.736829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.737569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.739452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.751305 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1181/2311] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:04.755953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.766964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c586c8-5cb0-48ba-8766-830f7a53c33b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.773054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.773957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.774238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.774505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] PATH_INFO: `/v3/projects/91226078726647b18b06d0c3bff5b4b4/users/8c5e3a50a46c443cb513f4f474128c4f/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.804496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91226078726647b18b06d0c3bff5b4b4, user_id=8c5e3a50a46c443cb513f4f474128c4f, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.809586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.834860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1131/2312] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:04 2022] PUT /identity/v3/projects/91226078726647b18b06d0c3bff5b4b4/users/8c5e3a50a46c443cb513f4f474128c4f/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:04.839064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.849786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1495c-af14-4bae-9c74-6dcd9a6fe42d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.915062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.915770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.916054 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.916415 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.917122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.918750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf484ed-932a-4468-a261-ce9904808e19 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.929761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1182/2313] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:04.936003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:04.946708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953663f-2ed7-45db-9064-7a9871f0247c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:04.951875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:04.952762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.953038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.953287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] PATH_INFO: `/v3/projects/91226078726647b18b06d0c3bff5b4b4/users/8c5e3a50a46c443cb513f4f474128c4f/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:04.955254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91226078726647b18b06d0c3bff5b4b4, user_id=8c5e3a50a46c443cb513f4f474128c4f, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:04.957951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:04.969399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1132/2314] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:04 2022] PUT /identity/v3/projects/91226078726647b18b06d0c3bff5b4b4/users/8c5e3a50a46c443cb513f4f474128c4f/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:04.981246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:04.981535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:04.981811 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:05.013465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] MFA Rules not processed for user `8c5e3a50a46c443cb513f4f474128c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:05.014813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:05.089424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1183/2315] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:05.102445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:05.104265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:05.169965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b250df-bbbd-40f7-b94c-940d178baf3f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:05.176340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:05.177131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:05.177481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:05.177856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:05.189955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:05.191628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4f08-aed3-4534-9e9d-ba1541d8538f service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:05.201987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1133/2316] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:05.281961 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:05.291888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c33170-4bae-4f6b-bfca-76e6b9266d04 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:05.296457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:05.297121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:05.297392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:05.297661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:05.359202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:05.360725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:05.370233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1184/2317] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:14.479355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074816d5-752f-4086-b470-63806d2ed4e7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:14.479995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074816d5-752f-4086-b470-63806d2ed4e7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:14.479995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074816d5-752f-4086-b470-63806d2ed4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:14.499741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-074816d5-752f-4086-b470-63806d2ed4e7 None None] MFA Rules not processed for user `95734a0c5b0d4a3babd3d5e70f42f15e`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:14.500952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-074816d5-752f-4086-b470-63806d2ed4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:14.564195 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1134/2318] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:20.425763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:20.489273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a424-06c9-44ea-a546-3662fe84b18d service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:20.494184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:20.495050 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:20.495324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:20.495593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] PATH_INFO: `/v3/users/b31558d5bf7942b9be102dee47ff9edd` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:20.496834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31558d5bf7942b9be102dee47ff9edd)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:20.498770 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:20.552357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31558d5bf7942b9be102dee47ff9edd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:20.562199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31558d5bf7942b9be102dee47ff9edd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:20.569098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31558d5bf7942b9be102dee47ff9edd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:20.582944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31558d5bf7942b9be102dee47ff9edd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:20.584172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31558d5bf7942b9be102dee47ff9edd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:20.591704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1185/2319] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:20 2022] DELETE /identity/v3/users/b31558d5bf7942b9be102dee47ff9edd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:20.596482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:20.597024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:20.597129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:20.615608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:20.617512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:20.690810 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1135/2320] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:20.703070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:20.705111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:20.770786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b40f1-e5bf-4fd0-86db-e3714270f1e3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:20.777802 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:20.778525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:20.778803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:20.779069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:20.789768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:20.791217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:20.801827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1186/2321] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:21.180070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:21.182117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:21.198943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1e48-6e84-48a2-9b64-b573e0593e13 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:21.207619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:21.208864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:21.209144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:21.209417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] PATH_INFO: `/v3/projects/873557e0180c4f7d848a326837579af4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:21.210910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873557e0180c4f7d848a326837579af4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:21.213047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:21.262623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873557e0180c4f7d848a326837579af4', 'request_id': 'req-33f42f01-e64e-454b-bee0-6c553569c0d1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.269913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873557e0180c4f7d848a326837579af4', 'request_id': 'req-33f42f01-e64e-454b-bee0-6c553569c0d1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.280901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873557e0180c4f7d848a326837579af4', 'request_id': 'req-33f42f01-e64e-454b-bee0-6c553569c0d1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.297083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] The token cache is being invalidate because project 873557e0180c4f7d848a326837579af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:21.297376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.298157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.299987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1136/2322] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:21 2022] DELETE /identity/v3/projects/873557e0180c4f7d848a326837579af4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:21.306413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:21.316973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace0c8-5317-4565-aee3-7b2ca69539ea service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:21.382608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:21.383499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:21.383817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:21.384099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] PATH_INFO: `/v3/users/8c5e3a50a46c443cb513f4f474128c4f` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:21.385340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5e3a50a46c443cb513f4f474128c4f)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:21.387371 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:21.437855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5e3a50a46c443cb513f4f474128c4f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.444746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5e3a50a46c443cb513f4f474128c4f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.452184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5e3a50a46c443cb513f4f474128c4f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.463527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5e3a50a46c443cb513f4f474128c4f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.464223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-96a6a925-c387-4cc1-a72c-4a7e0f8cd761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5e3a50a46c443cb513f4f474128c4f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.470054 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1187/2323] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:21 2022] DELETE /identity/v3/users/8c5e3a50a46c443cb513f4f474128c4f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:21.754295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:21.755913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:21.772213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42f01-e64e-454b-bee0-6c553569c0d1 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:21.843961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:21.844814 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:21.845083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:21.845349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] PATH_INFO: `/v3/projects/91226078726647b18b06d0c3bff5b4b4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:21.846570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=91226078726647b18b06d0c3bff5b4b4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:21.848533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:21.902399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91226078726647b18b06d0c3bff5b4b4', 'request_id': 'req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.909574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91226078726647b18b06d0c3bff5b4b4', 'request_id': 'req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.918601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91226078726647b18b06d0c3bff5b4b4', 'request_id': 'req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.931343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] The token cache is being invalidate because project 91226078726647b18b06d0c3bff5b4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:21.931644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.932446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1df78fb4-1a21-49a9-85a9-9820ba67d3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:21.934389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1137/2324] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:21 2022] DELETE /identity/v3/projects/91226078726647b18b06d0c3bff5b4b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:21.939948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:21.940310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:21.940618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:21.961258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:21.962395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:22.027753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1188/2325] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:22.037115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.037492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.037857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.057894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:22.059262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:22.068640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1138/2326] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:22.073708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.085290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb32d7-730d-425e-8e62-6e0b507f9185 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.091198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.092026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.092748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.093298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.094114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:22.094438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.096566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.113008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1189/2327] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:22.117726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.127443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02489b-e9b8-48d5-bef5-79c66a4eb814 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.133601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.134421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.134683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.134950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.135649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.137805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.170215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1139/2328] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:22.174510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.185521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21727b99-0c2f-47f2-b9ab-65d54dc08082 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.244209 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.244767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.245043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.245315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.246058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.248064 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.269516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1190/2329] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:22.274030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.284855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb197ddb-d7c0-402f-94fc-8c30181910c1 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.289827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.290505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.290785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.291064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.291843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.293645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.305847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1140/2330] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:22.309566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.320557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895c3c-f763-469f-b4c9-c8a0715636ad admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.326256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.327186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.327559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.327939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.329044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.330882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1e547-ec68-47b3-9dd7-2900b513b2cc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.342726 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1191/2331] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:22.346876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.357538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b2f48-03a5-46b3-ba86-db95089852cf admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.362179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.363088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.363367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.363643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] PATH_INFO: `/v3/projects/78a03ecc335c4e3989e51156b13bf974/users/2e402973ccef4638a3010ad003fd04af/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.378658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a03ecc335c4e3989e51156b13bf974, user_id=2e402973ccef4638a3010ad003fd04af, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.381376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.394918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1141/2332] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:22 2022] PUT /identity/v3/projects/78a03ecc335c4e3989e51156b13bf974/users/2e402973ccef4638a3010ad003fd04af/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:22.406223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.406526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.406760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.439121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] MFA Rules not processed for user `2e402973ccef4638a3010ad003fd04af`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:22.440376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:22.516822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1192/2333] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:22.522337 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.599652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef04cc-e224-4a29-9ecf-0da1bc96fab9 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.605387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.606068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.606345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.606615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.607323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.609326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.638994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1142/2334] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:22.644767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.656652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9be0-b044-4c89-8540-b70f0da5d8cf None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.715284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.715975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.716258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.716531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.717237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.719181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.741336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1193/2335] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:22.745623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.756475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c0e3-c75a-405b-811e-d62ecd221368 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.762321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.762978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.763254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.763518 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.764357 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.766007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.778104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1143/2336] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:22.782835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.794245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995c527-3dd4-472a-916b-7b134e9c55d5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.799552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.800495 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.800775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.801051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] PATH_INFO: `/v3/projects/23222c865c504ebb906830a0642ab8d9/users/4ca9c2c79b144a06a3b8355456a6a650/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.817864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23222c865c504ebb906830a0642ab8d9, user_id=4ca9c2c79b144a06a3b8355456a6a650, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.820607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.838468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1194/2337] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:22 2022] PUT /identity/v3/projects/23222c865c504ebb906830a0642ab8d9/users/4ca9c2c79b144a06a3b8355456a6a650/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:22.842737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.853452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42658de-86fc-4c18-b207-a8023a722300 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.916526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.917222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.917501 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.917963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.918687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.920403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11826959-cf75-4871-b749-75ce8a3d5036 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.932604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1144/2338] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:22.937173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:22.947867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df07d4-4b19-4f8a-a152-c1c96e070718 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:22.953669 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:22.954681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.955000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.955301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] PATH_INFO: `/v3/projects/23222c865c504ebb906830a0642ab8d9/users/4ca9c2c79b144a06a3b8355456a6a650/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:22.957427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23222c865c504ebb906830a0642ab8d9, user_id=4ca9c2c79b144a06a3b8355456a6a650, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:22.960099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:22.973215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1195/2339] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:22 2022] PUT /identity/v3/projects/23222c865c504ebb906830a0642ab8d9/users/4ca9c2c79b144a06a3b8355456a6a650/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:22.990524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:22.990806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:22.991123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:23.024285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] MFA Rules not processed for user `4ca9c2c79b144a06a3b8355456a6a650`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:23.025513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:23.096864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1145/2340] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:23.109089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:23.111086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:23.173284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a18ae-92de-4909-9e7b-ab5441117aa7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:23.177569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:23.178227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:23.178497 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:23.178763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:23.188596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:23.190041 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:23.200024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1196/2341] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:23.282214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:23.292402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7169-eab1-4964-97e4-d3e4dbdf7572 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:23.296243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:23.296879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:23.297158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:23.297420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:23.360221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:23.361787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1103167-ad68-4cda-a804-71e098c7b4a5 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:23.371530 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1146/2342] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:27.513593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:27.618551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6868-aa6b-40ce-bd81-d384da13a47e service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:27.623918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:27.624842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:27.625125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:27.625392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] PATH_INFO: `/v3/users/2e402973ccef4638a3010ad003fd04af` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:27.626764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e402973ccef4638a3010ad003fd04af)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:27.628869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:27.688387 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e402973ccef4638a3010ad003fd04af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:27.697465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e402973ccef4638a3010ad003fd04af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:27.705561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e402973ccef4638a3010ad003fd04af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:27.718938 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e402973ccef4638a3010ad003fd04af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:27.720023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e402973ccef4638a3010ad003fd04af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:27.726771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1197/2343] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:27 2022] DELETE /identity/v3/users/2e402973ccef4638a3010ad003fd04af => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:27.731482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:27.732069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:27.732278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:27.751325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:27.752611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:27.814742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1147/2344] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:27.825398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:27.826996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:27.885455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508d3e-b118-4fc8-912a-ea855c33296f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:27.889343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:27.890285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:27.890569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:27.890842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:27.900828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:27.902273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:27.914895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1198/2345] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:57:28.355790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:28.357314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:28.369323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00a3c-dbc6-44c1-bd2f-e15bf2946b25 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:28.374729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:28.375586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:28.376183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:28.376462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] PATH_INFO: `/v3/projects/78a03ecc335c4e3989e51156b13bf974` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:28.377681 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a03ecc335c4e3989e51156b13bf974)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:28.379704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:28.434796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a03ecc335c4e3989e51156b13bf974', 'request_id': 'req-f249d70c-d928-435a-acb2-fd63abfd9ce0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.442080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a03ecc335c4e3989e51156b13bf974', 'request_id': 'req-f249d70c-d928-435a-acb2-fd63abfd9ce0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.453371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a03ecc335c4e3989e51156b13bf974', 'request_id': 'req-f249d70c-d928-435a-acb2-fd63abfd9ce0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.464833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] The token cache is being invalidate because project 78a03ecc335c4e3989e51156b13bf974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:28.465205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.466001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.467789 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1148/2346] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:28 2022] DELETE /identity/v3/projects/78a03ecc335c4e3989e51156b13bf974 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:28.471804 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:28.482597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57f57-5a5a-4f6e-ae26-8de64682f8a7 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:28.542814 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:28.543877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:28.544153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:28.544556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] PATH_INFO: `/v3/users/4ca9c2c79b144a06a3b8355456a6a650` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:28.546178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca9c2c79b144a06a3b8355456a6a650)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:28.549672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:28.609600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca9c2c79b144a06a3b8355456a6a650'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.621672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca9c2c79b144a06a3b8355456a6a650'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.632227 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca9c2c79b144a06a3b8355456a6a650'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.648396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca9c2c79b144a06a3b8355456a6a650'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.649734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d5c420a2-3528-45fe-9ba5-442f5337a253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca9c2c79b144a06a3b8355456a6a650'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:28.663914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1199/2347] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:28 2022] DELETE /identity/v3/users/4ca9c2c79b144a06a3b8355456a6a650 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:28.977047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:28.978648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:28.999918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d70c-d928-435a-acb2-fd63abfd9ce0 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.076418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.077245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.077521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.077792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] PATH_INFO: `/v3/projects/23222c865c504ebb906830a0642ab8d9` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.079141 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23222c865c504ebb906830a0642ab8d9)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.081234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.137812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23222c865c504ebb906830a0642ab8d9', 'request_id': 'req-f5dc150b-6e43-4be3-8c89-52f4f414c996'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:29.147684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23222c865c504ebb906830a0642ab8d9', 'request_id': 'req-f5dc150b-6e43-4be3-8c89-52f4f414c996'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:29.156646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23222c865c504ebb906830a0642ab8d9', 'request_id': 'req-f5dc150b-6e43-4be3-8c89-52f4f414c996'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:29.168798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] The token cache is being invalidate because project 23222c865c504ebb906830a0642ab8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:29.169087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:29.169771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f5dc150b-6e43-4be3-8c89-52f4f414c996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:29.176497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1149/2348] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:28 2022] DELETE /identity/v3/projects/23222c865c504ebb906830a0642ab8d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:29.178007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.178362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.178706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.198164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:29.199442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:29.262488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1200/2349] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:57:29.270720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.271429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.271918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.291815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:29.293110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:29.301919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1150/2350] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:29.306213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.318300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806cfaa-4960-424e-a80b-56ed9393ff60 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.330321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.331117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.331507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.331897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.336964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:29.336964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.336964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.354192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1201/2351] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:29.359150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.371554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f2674-80f6-4896-8737-df3adf53b397 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.379443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.380420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.381120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.381455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.382235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.384486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.417444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1151/2352] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:29.418157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.436441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b0b-4226-461b-ae23-c711ad021a34 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.512905 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.513774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.513926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.514200 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.514926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.517121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.540374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1202/2353] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:29.544978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.556686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b9aa-f9ab-47b8-93fc-3ab069554712 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.562883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.563753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.564242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.564615 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.565436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.567229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.581035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1152/2354] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:29.584792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.595945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b629e5-d9ed-474a-ac75-f4a9c3a3b84b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.601056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.601837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.602186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.602567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.603391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.605295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28f5ec-0dad-4c2b-a7cc-c86575ba197b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.620515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1203/2355] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:29.622021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.636351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d918-2da5-4fad-8887-42badd2b5d20 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.643745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.644782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.645124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.645459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] PATH_INFO: `/v3/projects/ba0a2cfcc84445bea702643928992173/users/69ea26885509435ba1203f1eb015fd42/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.680077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0a2cfcc84445bea702643928992173, user_id=69ea26885509435ba1203f1eb015fd42, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.682965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.701737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1153/2356] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:29 2022] PUT /identity/v3/projects/ba0a2cfcc84445bea702643928992173/users/69ea26885509435ba1203f1eb015fd42/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:29.712539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.712937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.713249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.742628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] MFA Rules not processed for user `69ea26885509435ba1203f1eb015fd42`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:29.744034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:29.831989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1204/2357] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:29.836563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.901280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4d5-78e2-407b-bb9f-2f6f249e33f3 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:29.906857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:29.907532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:29.907846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:29.908121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:29.908834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:29.910778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:29.941199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1154/2358] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:29.947403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:29.958930 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16876c7-974d-46c0-abdc-44c96858b6f1 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.018491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.019174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.019455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.019944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.020640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.022964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.044652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1205/2359] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:29 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:30.048977 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:30.059835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56437ab-5fab-4cd8-8a0d-70098299cb10 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.065264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.065929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.066232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.066498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.067226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.068919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.080443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1155/2360] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:30.085219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:30.096193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12c75d-e185-48d0-8cd3-39fbc4b47e75 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.102025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.102947 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.103312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.103568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] PATH_INFO: `/v3/projects/6da6e73259354eb5aaa5d7815f97e337/users/b13ee8afbf8741dc845deb62583853bc/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.121651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da6e73259354eb5aaa5d7815f97e337, user_id=b13ee8afbf8741dc845deb62583853bc, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.125235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.140368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1206/2361] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:30 2022] PUT /identity/v3/projects/6da6e73259354eb5aaa5d7815f97e337/users/b13ee8afbf8741dc845deb62583853bc/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:30.146445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:30.158935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cdf8-b4d3-4e04-a4fe-72fbaa3bec7a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.214944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.215605 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.215922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.216192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.216918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.218550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137776-683e-45a4-bbc7-0e3f89a92d7a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.228167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1156/2362] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:30.232701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:30.243376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be239-5db8-4257-90c8-2f71874ad700 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.249776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.251039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.251453 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.251945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] PATH_INFO: `/v3/projects/6da6e73259354eb5aaa5d7815f97e337/users/b13ee8afbf8741dc845deb62583853bc/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.254880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da6e73259354eb5aaa5d7815f97e337, user_id=b13ee8afbf8741dc845deb62583853bc, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.257762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.269270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1207/2363] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:30 2022] PUT /identity/v3/projects/6da6e73259354eb5aaa5d7815f97e337/users/b13ee8afbf8741dc845deb62583853bc/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:30.281306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.281609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.281872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.314233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] MFA Rules not processed for user `b13ee8afbf8741dc845deb62583853bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:30.316105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:30.396347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1157/2364] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:30.407487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:30.410000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:30.486619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a90d-322a-40a7-8444-3ebb6d4b65c4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:30.490914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:30.491658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:30.491848 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:30.492125 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:30.551946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:30.553397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:30.562695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1208/2365] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:34.880653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:34.882151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:34.894620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05ce58-6f8b-4644-a356-c74dd356192c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:34.898936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:34.899600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:34.899979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:34.900250 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:34.910543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:34.912070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19110546-d11b-40a5-ad46-5dad97ff0a3a service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:34.922629 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1158/2366] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:39.840643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:39.908399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a633bb-0fe0-4c2a-a8c7-6e3804496c81 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:39.914002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:39.914921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:39.915213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:39.915484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] PATH_INFO: `/v3/users/69ea26885509435ba1203f1eb015fd42` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:39.916901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ea26885509435ba1203f1eb015fd42)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:39.918985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:39.971759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ea26885509435ba1203f1eb015fd42'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:39.981589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ea26885509435ba1203f1eb015fd42'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:39.989771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ea26885509435ba1203f1eb015fd42'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.002760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ea26885509435ba1203f1eb015fd42'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.003525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ea26885509435ba1203f1eb015fd42'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.011014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1209/2367] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:39 2022] DELETE /identity/v3/users/69ea26885509435ba1203f1eb015fd42 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:40.016694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:40.017333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:40.017333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:40.036391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:40.037606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:40.100599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1159/2368] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:40.111003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:40.112524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:40.172303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c913a53-b0d1-473c-9a64-c0c5494f9b5f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:40.176217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:40.176862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:40.177148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:40.177419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:40.187214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:40.188788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:40.199006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1210/2369] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:40.490285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:40.491755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:40.508206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68025e35-6015-4fc3-8ba0-10dad0a70ba0 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:40.514975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:40.515985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:40.516156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:40.516535 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] PATH_INFO: `/v3/projects/ba0a2cfcc84445bea702643928992173` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:40.518066 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0a2cfcc84445bea702643928992173)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:40.520137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:40.576707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0a2cfcc84445bea702643928992173', 'request_id': 'req-794d79d2-967f-400d-a2a8-413c12309fde'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.583628 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0a2cfcc84445bea702643928992173', 'request_id': 'req-794d79d2-967f-400d-a2a8-413c12309fde'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.592952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0a2cfcc84445bea702643928992173', 'request_id': 'req-794d79d2-967f-400d-a2a8-413c12309fde'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.606608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] The token cache is being invalidate because project ba0a2cfcc84445bea702643928992173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:40.606845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.607557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.609341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1160/2370] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:40 2022] DELETE /identity/v3/projects/ba0a2cfcc84445bea702643928992173 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:40.614073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:40.624544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4c-3ed8-446b-9c70-a568564be5f1 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:40.684315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:40.685380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:40.685763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:40.686131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] PATH_INFO: `/v3/users/b13ee8afbf8741dc845deb62583853bc` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:40.687718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13ee8afbf8741dc845deb62583853bc)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:40.690137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:40.747121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13ee8afbf8741dc845deb62583853bc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.754683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13ee8afbf8741dc845deb62583853bc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.762229 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13ee8afbf8741dc845deb62583853bc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.778418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13ee8afbf8741dc845deb62583853bc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.779284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1d33414a-0b95-4285-892d-9f2480542368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13ee8afbf8741dc845deb62583853bc'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:40.786081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1211/2371] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:40 2022] DELETE /identity/v3/users/b13ee8afbf8741dc845deb62583853bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:41.093879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.095497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:41.110639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d79d2-967f-400d-a2a8-413c12309fde admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.177334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.178122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.178404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.178683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] PATH_INFO: `/v3/projects/6da6e73259354eb5aaa5d7815f97e337` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.180025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da6e73259354eb5aaa5d7815f97e337)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.182038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.237424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da6e73259354eb5aaa5d7815f97e337', 'request_id': 'req-8f10b1f8-91a3-4c52-811a-fd3675474015'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:41.246168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da6e73259354eb5aaa5d7815f97e337', 'request_id': 'req-8f10b1f8-91a3-4c52-811a-fd3675474015'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:41.256034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da6e73259354eb5aaa5d7815f97e337', 'request_id': 'req-8f10b1f8-91a3-4c52-811a-fd3675474015'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:41.267499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] The token cache is being invalidate because project 6da6e73259354eb5aaa5d7815f97e337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:41.267912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:41.268658 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-8f10b1f8-91a3-4c52-811a-fd3675474015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:41.270379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1161/2372] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:41 2022] DELETE /identity/v3/projects/6da6e73259354eb5aaa5d7815f97e337 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:41.276992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.277506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.277635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.298279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:41.299555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:41.368442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1212/2373] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:41.377863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.378148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.378424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.398633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:41.399917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:41.410163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1162/2374] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:41.415311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.427128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46363-6253-4938-8e94-d8f506c5350d None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.449722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.450362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.450794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.451142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.451953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:41.452285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.454463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.468062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1213/2375] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:41.473610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.483405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d94a2-5238-419b-85fa-6106769ed93e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.488531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.489221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.489503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.489773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.490484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.492492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.521055 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1163/2376] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:41.525465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.536491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2426-8001-4706-a0a2-82c7228e5e12 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.596048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.596750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.597017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.597288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.598017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.600059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.623141 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1214/2377] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:41.627517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.639600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15795b50-a35e-4fa4-9878-9c3ff83cf1fd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.645435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.646816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.647295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.647900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.648842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.650859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.666252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1164/2378] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:41.670812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.683071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36932-7474-451b-bbad-d2a74df9879f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.689192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.689899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.690181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.690457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.691216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.693109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c89b43-e70b-4acb-97b5-ba54fe91ba99 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.709789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1215/2379] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:41.711738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.727744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc925-4e45-4238-91ca-0b7a30442c3d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.733895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.734893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.735279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.735694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] PATH_INFO: `/v3/projects/0bf3dced8c044bdd8401c0c16d7ec930/users/9c07512906a845a7a2c67090c1ac5aae/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.754599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf3dced8c044bdd8401c0c16d7ec930, user_id=9c07512906a845a7a2c67090c1ac5aae, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.757412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:41.774868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1165/2380] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:41 2022] PUT /identity/v3/projects/0bf3dced8c044bdd8401c0c16d7ec930/users/9c07512906a845a7a2c67090c1ac5aae/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:41.787045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf317-3690-4406-a429-20f236ede84e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.787359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf317-3690-4406-a429-20f236ede84e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.787636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf317-3690-4406-a429-20f236ede84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.820179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-06adf317-3690-4406-a429-20f236ede84e None None] MFA Rules not processed for user `9c07512906a845a7a2c67090c1ac5aae`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:41.821457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-06adf317-3690-4406-a429-20f236ede84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:41.909254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1216/2381] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:41.915288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:41.988143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bcdb-afdd-42a7-82e8-3a33ebb2f9a2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:41.993011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:41.993671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:41.993944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:41.994214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:41.994911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:41.996913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.028683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1166/2382] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:41 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:42.033578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adf317-3690-4406-a429-20f236ede84e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.044613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adf317-3690-4406-a429-20f236ede84e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.104156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.104870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.105154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.105438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.106118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.108374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.138789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1217/2383] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:42 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:42.144497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.155614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db3f2-0ab7-4d2f-baba-496638f7abc7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.160782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.161451 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.161724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.162021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.162754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.164599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.178410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1167/2384] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:42.184461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.197992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72968-9e4a-463e-8a07-c07c6d5a4cb3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.207216 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.207924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.208187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.208451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.209212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.210827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86a349-4183-45b9-a19e-a511a964d627 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.222518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1218/2385] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:42.227332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.238522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dd0ab-237c-4df3-b56e-e91cc0157121 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.245720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.247103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.247713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.248010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] PATH_INFO: `/v3/projects/c56ae987184441b982d6ac081f8644e0/users/fd8ae5380f344e8f83069411bf6a57e2/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.270548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56ae987184441b982d6ac081f8644e0, user_id=fd8ae5380f344e8f83069411bf6a57e2, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.273699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.290596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1168/2386] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:42 2022] PUT /identity/v3/projects/c56ae987184441b982d6ac081f8644e0/users/fd8ae5380f344e8f83069411bf6a57e2/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:42.302879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.303432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.303432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.335567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] MFA Rules not processed for user `fd8ae5380f344e8f83069411bf6a57e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:42.336951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:42.415099 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1219/2387] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:42.420107 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.495270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076d2d-074b-4317-902a-a616fea31bcd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.500598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.501269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.501571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.501836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.502606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.504585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.534540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1169/2388] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:42 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:42.539416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.553845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41c803-18af-4cb4-a9d0-4ac026664681 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.622745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.623555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.624126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.624452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.625287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.628411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.654889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1220/2389] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:42 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:42.657123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.668073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37136-1e05-4610-9093-b05d9e55de4d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.674005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.674685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.674932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.675242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.675997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.677649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.690374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1170/2390] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:57:42.696156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.706786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da99c-b80c-4138-bee0-c5ed6d0493a9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.712471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.713403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.713687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.713963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] PATH_INFO: `/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820/users/93ba4bdc354e4f1291b7eb2d6fab9d48/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.730467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fa6f65bd3a4fd0a6fda3d621a1d820, user_id=93ba4bdc354e4f1291b7eb2d6fab9d48, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.733455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.749234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1221/2391] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:42 2022] PUT /identity/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820/users/93ba4bdc354e4f1291b7eb2d6fab9d48/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:42.753327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.765621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d63a2-4632-458f-9bd5-c818d55ad97f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.825246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.825922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.826199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.826469 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.827198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.828884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76159-0d4b-47b3-a97b-aaac3d26964f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.841082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1171/2392] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:42.845584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:42.856554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea179f-6bae-4d83-aaa8-5af60dcb1af4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:42.862201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:42.863162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.863444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.863743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] PATH_INFO: `/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820/users/93ba4bdc354e4f1291b7eb2d6fab9d48/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.865820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fa6f65bd3a4fd0a6fda3d621a1d820, user_id=93ba4bdc354e4f1291b7eb2d6fab9d48, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:42.868547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:42.880198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1222/2393] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:42 2022] PUT /identity/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820/users/93ba4bdc354e4f1291b7eb2d6fab9d48/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:42.890575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:42.890867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:42.891169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:42.921261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] MFA Rules not processed for user `93ba4bdc354e4f1291b7eb2d6fab9d48`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:42.923180 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:42.995845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1172/2394] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:43.011267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:43.013429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:43.075153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08f5f-1bbc-4240-acdf-7215381574cb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:43.079084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:43.079737 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:43.080022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:43.080298 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:43.142926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:43.144529 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:43.157679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1223/2395] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:44.687818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:44.689293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:44.701505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64deec8-636f-4c88-8590-f58dc6e61139 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:44.705191 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:44.705836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:44.706117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:44.706401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:44.764759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:44.766247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:44.778808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1173/2396] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:45.375372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:45.384151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3922ac-8164-4e09-a2e0-ef2132feabda service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:45.388357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:45.389024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:45.389308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:45.389564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:45.399643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:45.401148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47269f2-3d06-4f38-9dce-45ca82a0d223 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:45.410992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1224/2397] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:49.355869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:49.429081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a8b5-86a5-4b86-85bc-e7e1d2811fe0 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:49.434476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:49.435343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:49.435621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:49.435920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] PATH_INFO: `/v3/users/9c07512906a845a7a2c67090c1ac5aae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:49.437165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c07512906a845a7a2c67090c1ac5aae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:49.439113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:49.494813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c07512906a845a7a2c67090c1ac5aae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:49.495483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c07512906a845a7a2c67090c1ac5aae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:49.503829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c07512906a845a7a2c67090c1ac5aae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:49.504627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c07512906a845a7a2c67090c1ac5aae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:49.515334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c07512906a845a7a2c67090c1ac5aae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:49.535161 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1174/2398] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:49 2022] DELETE /identity/v3/users/9c07512906a845a7a2c67090c1ac5aae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:49.540028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:49.540614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:49.540614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:49.559084 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:49.560340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:49.621155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1225/2399] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:57:49.631073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:49.632538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:49.695034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02042b7-3aa1-439c-a368-ff2a8f469845 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:49.699290 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:49.699963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:49.700255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:49.700519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:49.710626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:49.712402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:49.722747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1175/2400] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:50.092713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:50.094290 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:50.108574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6989-e006-47d9-994a-665139f04940 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:50.113632 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:50.114583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:50.114863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:50.115147 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] PATH_INFO: `/v3/projects/0bf3dced8c044bdd8401c0c16d7ec930` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:50.116381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf3dced8c044bdd8401c0c16d7ec930)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:50.118408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:50.168013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf3dced8c044bdd8401c0c16d7ec930', 'request_id': 'req-f38a7cad-e9c1-465f-b933-8f27b420d021'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.174301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf3dced8c044bdd8401c0c16d7ec930', 'request_id': 'req-f38a7cad-e9c1-465f-b933-8f27b420d021'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.181926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf3dced8c044bdd8401c0c16d7ec930', 'request_id': 'req-f38a7cad-e9c1-465f-b933-8f27b420d021'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.192381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] The token cache is being invalidate because project 0bf3dced8c044bdd8401c0c16d7ec930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:50.192648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.193370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.194944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1226/2401] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:50 2022] DELETE /identity/v3/projects/0bf3dced8c044bdd8401c0c16d7ec930 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:50.199192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:50.210480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5728e62-6445-4b68-8811-9e639f066c1d service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:50.272819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:50.273796 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:50.274057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:50.274328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] PATH_INFO: `/v3/users/fd8ae5380f344e8f83069411bf6a57e2` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:50.275562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8ae5380f344e8f83069411bf6a57e2)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:50.277565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:50.328741 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8ae5380f344e8f83069411bf6a57e2'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.329780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8ae5380f344e8f83069411bf6a57e2'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.339086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8ae5380f344e8f83069411bf6a57e2'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.339765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8ae5380f344e8f83069411bf6a57e2'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.348517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8ae5380f344e8f83069411bf6a57e2'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.368666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1176/2402] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:50 2022] DELETE /identity/v3/users/fd8ae5380f344e8f83069411bf6a57e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:50.683001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:50.684518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:50.699021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7cad-e9c1-465f-b933-8f27b420d021 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:50.762106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:50.762990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:50.763265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:50.763535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] PATH_INFO: `/v3/projects/c56ae987184441b982d6ac081f8644e0` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:50.764794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56ae987184441b982d6ac081f8644e0)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:50.766733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:50.815458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56ae987184441b982d6ac081f8644e0', 'request_id': 'req-24f5ac93-d3b7-4342-8521-9daa7ac4416a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.821859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56ae987184441b982d6ac081f8644e0', 'request_id': 'req-24f5ac93-d3b7-4342-8521-9daa7ac4416a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.831775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56ae987184441b982d6ac081f8644e0', 'request_id': 'req-24f5ac93-d3b7-4342-8521-9daa7ac4416a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.843629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] The token cache is being invalidate because project c56ae987184441b982d6ac081f8644e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:50.843847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.844423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:50.846045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1227/2403] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:50 2022] DELETE /identity/v3/projects/c56ae987184441b982d6ac081f8644e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:57:50.850487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:50.852298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:50.866386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8162-12bb-4f1a-b072-4aa9b6444630 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:50.934645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:50.935523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:50.935842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:50.936117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] PATH_INFO: `/v3/users/93ba4bdc354e4f1291b7eb2d6fab9d48` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:50.937446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ba4bdc354e4f1291b7eb2d6fab9d48)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:50.939476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:51.007034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ba4bdc354e4f1291b7eb2d6fab9d48'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.007716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ba4bdc354e4f1291b7eb2d6fab9d48'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.016325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ba4bdc354e4f1291b7eb2d6fab9d48'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.017065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ba4bdc354e4f1291b7eb2d6fab9d48'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.026841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-629a46a9-f1c5-48c7-aec2-b63c098e67b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ba4bdc354e4f1291b7eb2d6fab9d48'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.046456 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1177/2404] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:57:50 2022] DELETE /identity/v3/users/93ba4bdc354e4f1291b7eb2d6fab9d48 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:51.453815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:51.455774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:51.471609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5ac93-d3b7-4342-8521-9daa7ac4416a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:51.533957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:51.534847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.535145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.535398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] PATH_INFO: `/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.536747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fa6f65bd3a4fd0a6fda3d621a1d820)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:51.538697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:51.594406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fa6f65bd3a4fd0a6fda3d621a1d820', 'request_id': 'req-683d8d70-9967-4b62-93ad-1bb97a64ee9f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.601916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fa6f65bd3a4fd0a6fda3d621a1d820', 'request_id': 'req-683d8d70-9967-4b62-93ad-1bb97a64ee9f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.610764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fa6f65bd3a4fd0a6fda3d621a1d820', 'request_id': 'req-683d8d70-9967-4b62-93ad-1bb97a64ee9f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.629586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] The token cache is being invalidate because project 19fa6f65bd3a4fd0a6fda3d621a1d820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:57:51.630095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.631206 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-683d8d70-9967-4b62-93ad-1bb97a64ee9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:57:51.637827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1228/2405] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:57:51 2022] DELETE /identity/v3/projects/19fa6f65bd3a4fd0a6fda3d621a1d820 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:51.646208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.646881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.647168 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.669489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:51.671080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:51.739851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1178/2406] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:51.752289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.752962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.753140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.776394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:51.777644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:51.786132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1229/2407] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:51.791069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:51.801743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1079-0f9c-47b2-a212-31cee2ea32c1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:51.806786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:51.807450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.807765 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.808053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.808801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:57:51.809104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:51.810786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:51.827127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1179/2408] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:57:51.833239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:51.843516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d5f5-71e9-4845-bc16-263f81b0f541 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:51.848631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:51.849321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.849608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.856011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.856011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:51.856011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:51.882511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1230/2409] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:57:51 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:57:51.887297 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:51.901924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc43c-0f26-4b80-94b1-4ffdecc9fecf admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:51.977863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:51.979010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:51.979578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:51.980088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:51.981347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:51.985117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:52.012607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1180/2410] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:57:51 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:57:52.016998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:52.030589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56e78-e6f0-4b74-bf4c-6173933797cd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:52.036333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:52.037176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:52.037593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:52.038045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:52.039819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:52.042097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:52.054878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1231/2411] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:57:52.059213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:52.073981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ad85-208e-43b5-9ba4-b261470cde12 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:52.082411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:52.082899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:52.083396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:52.083916 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:52.085302 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:52.088617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52563eb7-1670-413d-b57a-55c9a790752f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:52.113057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1181/2412] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:57:52.114587 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:52.126160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936bc1-c227-4587-b43c-98f6d9f14465 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:52.131210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:52.132158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:52.132439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:52.132790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] PATH_INFO: `/v3/projects/24314485e2994647bc4d23b388d7fd70/users/da983bbe28974b92ac39e48aa7d7da71/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:52.150137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24314485e2994647bc4d23b388d7fd70, user_id=da983bbe28974b92ac39e48aa7d7da71, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:52.153000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:52.172745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1232/2413] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:57:52 2022] PUT /identity/v3/projects/24314485e2994647bc4d23b388d7fd70/users/da983bbe28974b92ac39e48aa7d7da71/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:57:52.183627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b18-924e-4d81-9da4-9fd5bad869d3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:52.183954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b18-924e-4d81-9da4-9fd5bad869d3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:52.184934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b18-924e-4d81-9da4-9fd5bad869d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:52.214393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-473e0b18-924e-4d81-9da4-9fd5bad869d3 None None] MFA Rules not processed for user `da983bbe28974b92ac39e48aa7d7da71`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:52.215848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-473e0b18-924e-4d81-9da4-9fd5bad869d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:52.294522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1182/2414] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:57:52.308858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:57:52.310914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:52.415215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a007ee1-b8ee-42f5-b00f-34a5700e8736 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:57:52.424328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:57:52.425037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:52.425518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:52.426006 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:52.445589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:57:52.447435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:57:52.465901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1233/2415] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:57:56.137481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e245-a314-4182-bcec-2709d115292e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:57:56.138138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e245-a314-4182-bcec-2709d115292e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:57:56.138138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e245-a314-4182-bcec-2709d115292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:57:56.158376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-26e6e245-a314-4182-bcec-2709d115292e None None] MFA Rules not processed for user `a440a1183fca4565a84e009d99acf813`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:57:56.159590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-26e6e245-a314-4182-bcec-2709d115292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:57:56.225766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1183/2416] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:19.908904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:19.980550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3435c4-ab90-4ebd-9016-78299339bcb4 service glance] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:19.985797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:19.986705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:19.987777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:19.987777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] PATH_INFO: `/v3/users/da983bbe28974b92ac39e48aa7d7da71` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:19.988965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da983bbe28974b92ac39e48aa7d7da71)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:19.990959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:20.047718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da983bbe28974b92ac39e48aa7d7da71'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.058250 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da983bbe28974b92ac39e48aa7d7da71'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.071790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da983bbe28974b92ac39e48aa7d7da71'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.091366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da983bbe28974b92ac39e48aa7d7da71'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.092566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da983bbe28974b92ac39e48aa7d7da71'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.103330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1234/2417] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:58:19 2022] DELETE /identity/v3/users/da983bbe28974b92ac39e48aa7d7da71 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:58:20.108552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:20.109452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:20.109452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:20.129362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:20.130852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:20.225448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1184/2418] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:58:20.233648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:20.235431 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:20.315889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cba2-4b97-4d1f-99b7-b1c230b2f377 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:20.320473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:20.321205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:20.321550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:20.321932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:20.338748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:20.340687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c88b4-e438-44f7-ab88-31d8461741f6 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:20.352275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1235/2419] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:58:20.743065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:20.745331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:20.765932 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb10a-1b80-4760-bee3-c7239a634295 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:20.775566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:20.777185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:20.777718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:20.778228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] PATH_INFO: `/v3/projects/24314485e2994647bc4d23b388d7fd70` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:20.780264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24314485e2994647bc4d23b388d7fd70)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:20.782424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:20.840931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24314485e2994647bc4d23b388d7fd70', 'request_id': 'req-d6d994ac-54de-4100-b842-3e83f5f8d861'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.848788 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24314485e2994647bc4d23b388d7fd70', 'request_id': 'req-d6d994ac-54de-4100-b842-3e83f5f8d861'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.857818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24314485e2994647bc4d23b388d7fd70', 'request_id': 'req-d6d994ac-54de-4100-b842-3e83f5f8d861'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.869762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] The token cache is being invalidate because project 24314485e2994647bc4d23b388d7fd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:58:20.870132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.870907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6d994ac-54de-4100-b842-3e83f5f8d861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:20.872839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1185/2420] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:58:20 2022] DELETE /identity/v3/projects/24314485e2994647bc4d23b388d7fd70 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:58:20.878416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:20.878777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:20.879092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:20.900597 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:20.902469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:20.972872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1236/2421] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:58:20.984831 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:20.985172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:20.985540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.005065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:21.006333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:21.014647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1186/2422] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:21.019498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.030852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fc315-43fc-4f12-9809-51eb08534ae3 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.035983 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.036686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.036965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.037254 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.037984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:58:21.038292 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.040027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.053557 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1237/2423] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:58:21.058685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.071554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5e312-fa21-426e-b07b-d79bc8d36901 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.079423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.080555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.081009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.081470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.082877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.086671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.125617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1187/2424] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:58:21 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:58:21.126764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.141342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3bd0-aac1-459b-b31d-745a6c0d1de3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.215635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.216383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.216686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.216984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.217787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.219966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.243615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1238/2425] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:58:21 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:58:21.248596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.260036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5c790-bdc1-4a0e-85e1-c681a81fffa0 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.265288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.266003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.266289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.266567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.267356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.269139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.283380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1188/2426] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:58:21.287656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.300219 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36b1-bf72-48a0-b8a7-39c62275e4b6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.305100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.305782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.306060 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.306334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.307076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.308736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbffa0-842a-49f5-a1d8-fca7f52516b5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.320303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1239/2427] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:58:21.325259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.336758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6615b1-252a-410b-8d9e-8f9db5d75897 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.343812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.345323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.345723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.346004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] PATH_INFO: `/v3/projects/dfbdbd4dbab24a8492307f995bbd5f4d/users/22a91e016dd54df4aaf4ab729a6a54f3/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.364506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbdbd4dbab24a8492307f995bbd5f4d, user_id=22a91e016dd54df4aaf4ab729a6a54f3, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.367247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.382256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1189/2428] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:58:21 2022] PUT /identity/v3/projects/dfbdbd4dbab24a8492307f995bbd5f4d/users/22a91e016dd54df4aaf4ab729a6a54f3/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:58:21.455317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17005c4-bcb5-4323-aa75-5815292e5633 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.455607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17005c4-bcb5-4323-aa75-5815292e5633 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.455925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17005c4-bcb5-4323-aa75-5815292e5633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.493296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a17005c4-bcb5-4323-aa75-5815292e5633 None None] MFA Rules not processed for user `22a91e016dd54df4aaf4ab729a6a54f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:21.494561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a17005c4-bcb5-4323-aa75-5815292e5633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:21.566803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1240/2429] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:21.579807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:21.581699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:21.649032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f7dd-5f1f-4b98-b2bf-85385ba9f997 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:21.653453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:21.654122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:21.654402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:21.654672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:21.665433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:21.666928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:21.678414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1190/2430] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:58:27.288509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:27.289008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:27.289122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:27.308894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:27.310193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:27.378664 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1241/2431] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:27.430800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:27.432436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:27.504004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f13ba-f6f2-4d0b-879c-f61d3eba114d service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:27.509490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:27.510137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:27.510414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:27.510687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:27.519225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:27.521214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae007ed-f078-4be3-9b68-3d0d29fc108d service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:27.529832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1191/2432] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:58:27.787607 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:27.912593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554e3d3-c384-4f1f-934f-0e45944ca4cb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:27.921816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:27.922868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:27.923539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:27.924051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] PATH_INFO: `/v3/users/22a91e016dd54df4aaf4ab729a6a54f3` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:27.926285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a91e016dd54df4aaf4ab729a6a54f3)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:27.929004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:28.012487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a91e016dd54df4aaf4ab729a6a54f3'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.026158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a91e016dd54df4aaf4ab729a6a54f3'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.039026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a91e016dd54df4aaf4ab729a6a54f3'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.055419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a91e016dd54df4aaf4ab729a6a54f3'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.056435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a91e016dd54df4aaf4ab729a6a54f3'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.064866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1242/2433] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:58:27 2022] DELETE /identity/v3/users/22a91e016dd54df4aaf4ab729a6a54f3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:58:28.071197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:28.071516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:28.072121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:28.090367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:28.091699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:28.175309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1192/2434] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:28.185365 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:28.187077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:28.281861 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774c123-8941-4ed7-9d2d-a3f9aa94317d admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:28.286357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:28.287273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:28.287721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:28.288093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:28.301591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:28.304316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:28.323845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1243/2435] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:58:28.830864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:28.835067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:28.860885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd103836-734a-4f14-8c09-402186f6eb1d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:28.876391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:28.877490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:28.877689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:28.877964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] PATH_INFO: `/v3/projects/dfbdbd4dbab24a8492307f995bbd5f4d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:28.880684 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbdbd4dbab24a8492307f995bbd5f4d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:28.882755 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:28.948987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbdbd4dbab24a8492307f995bbd5f4d', 'request_id': 'req-13c55cbc-156e-4013-adad-d1d0b2749a9d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.961284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbdbd4dbab24a8492307f995bbd5f4d', 'request_id': 'req-13c55cbc-156e-4013-adad-d1d0b2749a9d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.978931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbdbd4dbab24a8492307f995bbd5f4d', 'request_id': 'req-13c55cbc-156e-4013-adad-d1d0b2749a9d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.993279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] The token cache is being invalidate because project dfbdbd4dbab24a8492307f995bbd5f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:58:28.993947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:28.994866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13c55cbc-156e-4013-adad-d1d0b2749a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:58:29.011724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1193/2436] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:58:28 2022] DELETE /identity/v3/projects/dfbdbd4dbab24a8492307f995bbd5f4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:58:41.908146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:41.909796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:41.990196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae74cd0-2087-426b-983e-c704c07a7372 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:42.066573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:42.067548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:42.068025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:42.068304 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:42.070134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:42.082449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:42.084086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:42.094702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1244/2437] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:58:45.237783 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:45.238385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:45.238534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:45.260722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:58:45.261954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:45.330610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1194/2438] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:58:45.347024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:45.348683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:45.423545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97778f1c-0bbd-4f49-8dd4-2ca2b9506a8d service placement] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:45.429763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:45.430358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:45.430631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:45.430896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:45.440002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:45.441621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:45.450395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1245/2439] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:58:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:58:55.952603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:58:55.954304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:56.014098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5485d-be27-45ed-b945-e138fb286446 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:58:56.018466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:58:56.019121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:58:56.019398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:58:56.019687 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:58:56.021961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:58:56.088720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:58:56.089719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244d3b-db6e-4bd8-b5fd-b523f1f30c01 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:58:56.099981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1195/2440] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:03.298352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:03.308058 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eef80d-d141-4e9b-bc7c-e0f84778ec03 service swift] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:03.312128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:03.312761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:03.313037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:03.313308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:03.315266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:03.381796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:03.383288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:03.393897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1246/2441] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:04.682987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:04.683475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:04.683584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:04.701934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:04.703401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:04.712043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1196/2442] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:04.724917 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:04.736443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee6e4-0071-4220-b4d5-cb44aa2aa322 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:04.741714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:04.742374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:04.742640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:04.742927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:04.752207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:04.754207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:04.765358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1247/2443] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 14:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:59:10.537746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:10.539370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:10.558098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fbcfe-f915-46c6-a0b3-f9c398b0740e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:10.562864 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:10.563862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:10.564142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:10.564418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] PATH_INFO: `/v3/users/549954ffc4af4de0a0c680385407756a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:10.565646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549954ffc4af4de0a0c680385407756a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:10.567621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:10.617265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549954ffc4af4de0a0c680385407756a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.617909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549954ffc4af4de0a0c680385407756a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.624503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549954ffc4af4de0a0c680385407756a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.625127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549954ffc4af4de0a0c680385407756a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.632624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549954ffc4af4de0a0c680385407756a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.650040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1197/2444] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:10 2022] DELETE /identity/v3/users/549954ffc4af4de0a0c680385407756a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:10.829810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:10.841273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197bc17-20b5-4673-9e40-e34ff8b5ec96 service swift] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:10.906402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:10.907942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:10.907942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:10.907942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] PATH_INFO: `/v3/projects/666459593d89453f9c18f63d5ad5021f` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:10.909044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=666459593d89453f9c18f63d5ad5021f)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:10.910965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:10.961937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666459593d89453f9c18f63d5ad5021f', 'request_id': 'req-c5a227dd-7660-46d6-a791-099d63377380'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.969698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666459593d89453f9c18f63d5ad5021f', 'request_id': 'req-c5a227dd-7660-46d6-a791-099d63377380'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.979119 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666459593d89453f9c18f63d5ad5021f', 'request_id': 'req-c5a227dd-7660-46d6-a791-099d63377380'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.990725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] The token cache is being invalidate because project 666459593d89453f9c18f63d5ad5021f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:10.991010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.991691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:10.993424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1248/2445] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:10 2022] DELETE /identity/v3/projects/666459593d89453f9c18f63d5ad5021f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:10.997709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:10.999383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:11.015187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619675f-688e-403d-8471-0409870b5c54 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:11.086809 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:11.088317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:11.088734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:11.089111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] PATH_INFO: `/v3/users/1a7e70467d8c49baac0e26d6ce65c8be` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:11.091059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7e70467d8c49baac0e26d6ce65c8be)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:11.094602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:11.160468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7e70467d8c49baac0e26d6ce65c8be'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.161245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7e70467d8c49baac0e26d6ce65c8be'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.169966 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7e70467d8c49baac0e26d6ce65c8be'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.170827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7e70467d8c49baac0e26d6ce65c8be'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.180611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7e70467d8c49baac0e26d6ce65c8be'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.203773 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1198/2446] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:10 2022] DELETE /identity/v3/users/1a7e70467d8c49baac0e26d6ce65c8be => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:11.399155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:11.400932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:11.422372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a227dd-7660-46d6-a791-099d63377380 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:11.509889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:11.511184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:11.511586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:11.511989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] PATH_INFO: `/v3/projects/a425fccc9f6847adbc931182a4335084` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:11.514176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a425fccc9f6847adbc931182a4335084)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:11.517137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:11.590959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a425fccc9f6847adbc931182a4335084', 'request_id': 'req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.597756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a425fccc9f6847adbc931182a4335084', 'request_id': 'req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.609313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a425fccc9f6847adbc931182a4335084', 'request_id': 'req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.624642 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] The token cache is being invalidate because project a425fccc9f6847adbc931182a4335084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:11.624928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.625875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:11.628170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1249/2447] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:11 2022] DELETE /identity/v3/projects/a425fccc9f6847adbc931182a4335084 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:59:31.929128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:31.930698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:32.002361 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27526df-2d80-44dd-9ebb-1b45e9070dfd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:32.056121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:32.056790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:32.057081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:32.057343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:32.059519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:32.124036 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:32.125664 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:32.137787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1199/2448] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:35.932682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:35.934420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:35.948868 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9b2b5-a2cb-426e-812a-c87ada20eeb6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:35.954294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:35.955562 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:35.955989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:35.956217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] PATH_INFO: `/v3/users/95734a0c5b0d4a3babd3d5e70f42f15e` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:35.957678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95734a0c5b0d4a3babd3d5e70f42f15e)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:35.959953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.013644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95734a0c5b0d4a3babd3d5e70f42f15e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.022407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95734a0c5b0d4a3babd3d5e70f42f15e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.030949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95734a0c5b0d4a3babd3d5e70f42f15e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.044385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95734a0c5b0d4a3babd3d5e70f42f15e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.045195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-47be4e97-85f1-4482-bd2f-2246c9296ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95734a0c5b0d4a3babd3d5e70f42f15e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.051906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1250/2449] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:35 2022] DELETE /identity/v3/users/95734a0c5b0d4a3babd3d5e70f42f15e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:36.258657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.270039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975c6c-ae06-4fa3-83dc-50a6f3505dd1 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.354002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.354884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.355160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.355431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] PATH_INFO: `/v3/projects/b0daf03d413044a1921655eb34fb4703` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.356897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0daf03d413044a1921655eb34fb4703)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.358874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.420959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0daf03d413044a1921655eb34fb4703', 'request_id': 'req-1776f5a4-653a-4c7f-b626-4efb26aa89e4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.428213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0daf03d413044a1921655eb34fb4703', 'request_id': 'req-1776f5a4-653a-4c7f-b626-4efb26aa89e4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.437565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0daf03d413044a1921655eb34fb4703', 'request_id': 'req-1776f5a4-653a-4c7f-b626-4efb26aa89e4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.448262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] The token cache is being invalidate because project b0daf03d413044a1921655eb34fb4703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:36.448546 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.449190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-1776f5a4-653a-4c7f-b626-4efb26aa89e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:36.450854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1200/2450] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:36 2022] DELETE /identity/v3/projects/b0daf03d413044a1921655eb34fb4703 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:36.456169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.456445 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.456715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.477349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:36.478615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:36.543272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1251/2451] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:36.551495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.551800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.552078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.573556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:36.574777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:36.582921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1201/2452] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:36.587475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.598202 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c30277-d299-42e9-9397-aacf26b4d302 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.604140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.604828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.605102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.605370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.606133 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:59:36.606458 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.608204 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.622273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1252/2453] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:59:36.627648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.638208 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e64c-e1b6-49ca-bd08-9fc940e391e2 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.643338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.644062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.644335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.644601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.645345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.647643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.678574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1202/2454] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:36 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:36.683552 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.695140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9301d-25d9-4862-9021-15061cf61a0b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.766819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.767515 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.767832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.768109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.768933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.771223 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.794090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1253/2455] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:36 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:36.799129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.812413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597df86-6ee3-45b0-964d-6a28159f0fae admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.817697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.818371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.818642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.818913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.819655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.821343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.832853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1203/2456] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:36.838590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.849183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd54d4-f3a1-4332-8fc4-e63df1440ac0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.854279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.855053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.855331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.855599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.856424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.858105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078feb9f-1905-417f-8431-7b5f878f4389 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.869799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1254/2457] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:36.874641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:36.885307 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3be84-426b-4f60-b5e1-903badcaa803 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:36.890580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:36.891644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.892003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.892397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] PATH_INFO: `/v3/projects/ce8283e8baf148c4bc94a841bff4cebc/users/e2ec4163e750480d9e0a6acc70e814af/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.910360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8283e8baf148c4bc94a841bff4cebc, user_id=e2ec4163e750480d9e0a6acc70e814af, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:36.913412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:36.928626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1204/2458] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:36 2022] PUT /identity/v3/projects/ce8283e8baf148c4bc94a841bff4cebc/users/e2ec4163e750480d9e0a6acc70e814af/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:36.939271 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:36.940001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:36.940001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:36.970579 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] MFA Rules not processed for user `e2ec4163e750480d9e0a6acc70e814af`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:36.972028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:37.074212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1255/2459] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:37.079310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.165400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52bfa-ab5b-411a-80f3-65a0b122c52d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.172519 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.173401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.173745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.174086 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.175002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.177114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.209238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1205/2460] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:37 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:37.213954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.225795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43921d-4b38-4c2b-a8e7-a4a4309205e8 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.304100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.305307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.305803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.306306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.307572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.311564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.342792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1256/2461] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:37 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:37.347132 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.359614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427beb-3bbd-4f1b-8eba-5a711512bf95 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.365586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.366300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.366579 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.366848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.367593 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.369332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.382353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1206/2462] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:37.387033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.398285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02efe27-169f-4bf1-b6c4-e425eeeb70ad admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.403494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.404827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.405278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.405613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] PATH_INFO: `/v3/projects/2335ce1c533e4269852dc74effd4564e/users/0b9a4addaf6c4128893547c39dcb8842/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.423402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2335ce1c533e4269852dc74effd4564e, user_id=0b9a4addaf6c4128893547c39dcb8842, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.426161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.441925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1257/2463] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:37 2022] PUT /identity/v3/projects/2335ce1c533e4269852dc74effd4564e/users/0b9a4addaf6c4128893547c39dcb8842/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:37.446171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.457875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b014b-61f9-4ee5-9c00-215e6e011f29 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.541453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.542609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.543088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.543607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.544960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.547964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c8021-1ae3-469a-8af5-dc9be9e1affb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.566881 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1207/2464] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:37.571502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.583138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b68c2-6b8e-43d3-b856-da1ea7238e57 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.589146 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.590190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.590483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.590862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] PATH_INFO: `/v3/projects/2335ce1c533e4269852dc74effd4564e/users/0b9a4addaf6c4128893547c39dcb8842/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.593270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2335ce1c533e4269852dc74effd4564e, user_id=0b9a4addaf6c4128893547c39dcb8842, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.596120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.608230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1258/2465] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:37 2022] PUT /identity/v3/projects/2335ce1c533e4269852dc74effd4564e/users/0b9a4addaf6c4128893547c39dcb8842/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:37.621516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.622082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.622556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.668480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] MFA Rules not processed for user `0b9a4addaf6c4128893547c39dcb8842`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:37.670647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:37.759973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1208/2466] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:37.771942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.774459 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:37.849764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c269-df51-4b76-903f-337520634040 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.854180 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.854588 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.854866 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.855156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:37.868542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:37.872715 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:37.883846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1259/2467] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:37.970749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:37.981911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85550508-69c1-41ec-ae8d-5f05d4e5d9be None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:37.986929 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:37.988121 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:37.988644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:37.989179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:38.050905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:38.052666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2521-9445-4424-a66b-27076ff93d9c service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:38.066184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1209/2468] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:45.098815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:45.165508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd1d5-227a-44c6-a455-019b30214d8e service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:45.171358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:45.172509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:45.172896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:45.173308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] PATH_INFO: `/v3/users/e2ec4163e750480d9e0a6acc70e814af` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:45.174721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ec4163e750480d9e0a6acc70e814af)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:45.176887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:45.237144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ec4163e750480d9e0a6acc70e814af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:45.248817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ec4163e750480d9e0a6acc70e814af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:45.257309 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ec4163e750480d9e0a6acc70e814af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:45.271774 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ec4163e750480d9e0a6acc70e814af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:45.272590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ec4163e750480d9e0a6acc70e814af'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:45.279536 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1260/2469] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:45 2022] DELETE /identity/v3/users/e2ec4163e750480d9e0a6acc70e814af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:45.284338 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:45.285125 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:45.285309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:45.313351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:45.315365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:45.416062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1210/2470] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:45.427433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:45.429057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:45.507630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7e57-4fa1-4354-8666-f34debf1f7c8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:45.514685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:45.515989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:45.516522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:45.517024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:45.535102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:45.537606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:45.553862 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1261/2471] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:45.923117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:45.926124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:45.950026 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9218-d08b-466d-b332-519f21efa37a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:45.958835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:45.960339 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:45.960860 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:45.961393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] PATH_INFO: `/v3/projects/ce8283e8baf148c4bc94a841bff4cebc` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:45.964521 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8283e8baf148c4bc94a841bff4cebc)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:45.968197 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:46.075904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8283e8baf148c4bc94a841bff4cebc', 'request_id': 'req-99e96d16-fdf1-4757-add9-f6f175947dae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.082406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8283e8baf148c4bc94a841bff4cebc', 'request_id': 'req-99e96d16-fdf1-4757-add9-f6f175947dae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.091446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8283e8baf148c4bc94a841bff4cebc', 'request_id': 'req-99e96d16-fdf1-4757-add9-f6f175947dae'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.104342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] The token cache is being invalidate because project ce8283e8baf148c4bc94a841bff4cebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:46.104786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.105656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.107491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1211/2472] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:45 2022] DELETE /identity/v3/projects/ce8283e8baf148c4bc94a841bff4cebc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:46.112403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:46.123286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0d450-3bc1-4a35-966d-d6c0b202fc6f service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:46.194321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:46.195235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:46.195563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:46.195921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] PATH_INFO: `/v3/users/0b9a4addaf6c4128893547c39dcb8842` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:46.197279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9a4addaf6c4128893547c39dcb8842)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:46.199419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:46.257376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9a4addaf6c4128893547c39dcb8842'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.268883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9a4addaf6c4128893547c39dcb8842'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.277591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9a4addaf6c4128893547c39dcb8842'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.293940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9a4addaf6c4128893547c39dcb8842'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.294540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6d6459cc-adba-44ed-8836-ff9434916745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9a4addaf6c4128893547c39dcb8842'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.301684 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1262/2473] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:46 2022] DELETE /identity/v3/users/0b9a4addaf6c4128893547c39dcb8842 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:46.658769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:46.662199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:46.686709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96d16-fdf1-4757-add9-f6f175947dae admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:46.773321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:46.774620 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:46.774995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:46.775475 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] PATH_INFO: `/v3/projects/2335ce1c533e4269852dc74effd4564e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:46.777602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2335ce1c533e4269852dc74effd4564e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:46.781470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:46.868263 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2335ce1c533e4269852dc74effd4564e', 'request_id': 'req-e24315fe-2c5b-4cce-94e5-d25e9bc20166'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.879564 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2335ce1c533e4269852dc74effd4564e', 'request_id': 'req-e24315fe-2c5b-4cce-94e5-d25e9bc20166'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.891467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2335ce1c533e4269852dc74effd4564e', 'request_id': 'req-e24315fe-2c5b-4cce-94e5-d25e9bc20166'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.911111 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] The token cache is being invalidate because project 2335ce1c533e4269852dc74effd4564e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:46.911627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.912763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-e24315fe-2c5b-4cce-94e5-d25e9bc20166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:46.915515 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1212/2474] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:46 2022] DELETE /identity/v3/projects/2335ce1c533e4269852dc74effd4564e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:46.922023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:46.922389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:46.922830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:46.945985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:46.948533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:47.033170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1263/2475] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:47.042446 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.042706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.042992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.064869 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:47.066122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:47.075499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1213/2476] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:47.080189 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.091468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fcb95-f16d-4b38-8bf2-aff96f7caa51 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.096906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.097594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.097867 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.098156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.098897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:59:47.099211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.100880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.117164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1264/2477] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:59:47.121408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.131720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ceee-7fec-485f-be9e-0c1d59f1fcb5 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.136858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.137612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.137890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.138162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.138862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.140877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.172838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1214/2478] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:47.179906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.197839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184805c-3b0f-4249-bf7a-2a065d9cf790 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.278822 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.279522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.279888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.280197 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.280914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.282997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.309779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1265/2479] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:47.311137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.321866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6c16-55f4-47c1-aba9-f448f4ff059a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.331167 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.331906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.332190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.332467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.333245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.334930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.356051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1215/2480] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:47.362065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.375443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ce2c7-85b0-4aa9-aff3-6d79830a659a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.381113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.381803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.382150 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.382690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.383540 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.385123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedc820-1931-4e44-a431-336290ca2b3f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.404299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1266/2481] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:47.409131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.420638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8dd4-1351-4db3-9277-6b5ee7c25e79 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.426437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.427368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.427644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.427962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] PATH_INFO: `/v3/projects/848b4267773845fb921f106193a72843/users/1ba7c2b08c1644039cff2a45b06e8d24/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.446719 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848b4267773845fb921f106193a72843, user_id=1ba7c2b08c1644039cff2a45b06e8d24, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.449570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.488504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1216/2482] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:47 2022] PUT /identity/v3/projects/848b4267773845fb921f106193a72843/users/1ba7c2b08c1644039cff2a45b06e8d24/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:59:47.508199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.508721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.509243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.540140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] MFA Rules not processed for user `1ba7c2b08c1644039cff2a45b06e8d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:47.541391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:47.619076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1267/2483] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:47.624392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.695130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4082-b9c0-47ee-8b70-08a1154d2771 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.700877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.701567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.701848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.702122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.702845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.704908 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.738833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1217/2484] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:59:47.742489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.754633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f41f7-097b-480a-84e7-57a93c91770a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.828334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.830906 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.831299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.831709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.832560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.834779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.861636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1268/2485] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:47 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:59:47.866948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.881848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7339c-da9c-44c3-8d10-6be8200dc86c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.888274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.889052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.889336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.889607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.890463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.892187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.905176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1218/2486] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:47.909896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.921201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c854d4-b973-44a5-ab81-5bbf0cb6f8e8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:47.926660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:47.927569 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:47.927883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:47.928154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] PATH_INFO: `/v3/projects/4d84a9c874d44926955b9945452e09ac/users/90269e8be13b4ac1bcb21162cf6d4555/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:47.945397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d84a9c874d44926955b9945452e09ac, user_id=90269e8be13b4ac1bcb21162cf6d4555, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:47.948433 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:47.964760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1269/2487] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:47 2022] PUT /identity/v3/projects/4d84a9c874d44926955b9945452e09ac/users/90269e8be13b4ac1bcb21162cf6d4555/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:47.969221 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:47.981457 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2914-a27b-4f49-8b50-9df487f50ba3 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:48.065618 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:48.066389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:48.066664 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:48.067035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:48.068490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:48.071705 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3668e-0b3d-4d0d-80ca-996f59952860 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:48.091699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1219/2488] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:48.096478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:48.108886 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbcc8f-bde1-4e76-a823-2aeaed7754aa admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:48.115269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:48.116372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:48.116698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:48.117025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] PATH_INFO: `/v3/projects/4d84a9c874d44926955b9945452e09ac/users/90269e8be13b4ac1bcb21162cf6d4555/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:48.119473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d84a9c874d44926955b9945452e09ac, user_id=90269e8be13b4ac1bcb21162cf6d4555, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:48.122368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:48.135812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1270/2489] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:48 2022] PUT /identity/v3/projects/4d84a9c874d44926955b9945452e09ac/users/90269e8be13b4ac1bcb21162cf6d4555/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:48.147188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:48.147523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:48.148022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:48.178606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] MFA Rules not processed for user `90269e8be13b4ac1bcb21162cf6d4555`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:48.180122 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:48.269702 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1220/2490] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:48.283571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:48.286446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:48.395017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099778e-9616-4c10-9166-5c7a4b8dcdd0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:48.401673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:48.402690 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:48.403157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:48.403605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:48.420610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:48.422953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2607f-9641-4d65-ae56-68b3abfc39f5 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:48.441116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1271/2491] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:48.909568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:48.991902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c711e-a010-4e85-9ce9-addc006cc187 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:48.997300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:48.998228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:48.998495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:48.998841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] PATH_INFO: `/v3/users/1ba7c2b08c1644039cff2a45b06e8d24` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:49.000258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba7c2b08c1644039cff2a45b06e8d24)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:49.002496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:49.060366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba7c2b08c1644039cff2a45b06e8d24'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.061129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba7c2b08c1644039cff2a45b06e8d24'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.070495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba7c2b08c1644039cff2a45b06e8d24'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.071420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba7c2b08c1644039cff2a45b06e8d24'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.081151 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba7c2b08c1644039cff2a45b06e8d24'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.106815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1221/2492] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:48 2022] DELETE /identity/v3/users/1ba7c2b08c1644039cff2a45b06e8d24 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:49.111768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:49.112066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:49.112339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:49.130957 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:49.132262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:49.201238 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1272/2493] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:59:49.212103 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:49.214536 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:49.304650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c049-488a-4519-b518-0680cd8d06de admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:49.309097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:49.309852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:49.310189 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:49.310603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:49.321340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:49.324092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:49.336048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1222/2494] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:49.708377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:49.710002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:49.729025 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e509-d8e1-49d7-815e-6f17f829c829 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:49.735109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:49.736276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:49.736700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:49.737102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] PATH_INFO: `/v3/projects/848b4267773845fb921f106193a72843` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:49.739110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848b4267773845fb921f106193a72843)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:49.742144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:49.814069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848b4267773845fb921f106193a72843', 'request_id': 'req-ce86a1f7-1e3a-432e-add4-a130b3f94638'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.826782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848b4267773845fb921f106193a72843', 'request_id': 'req-ce86a1f7-1e3a-432e-add4-a130b3f94638'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.844836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848b4267773845fb921f106193a72843', 'request_id': 'req-ce86a1f7-1e3a-432e-add4-a130b3f94638'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.870494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] The token cache is being invalidate because project 848b4267773845fb921f106193a72843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:49.871173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.872128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:49.874681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1273/2495] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:49 2022] DELETE /identity/v3/projects/848b4267773845fb921f106193a72843 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:49.882544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:49.898926 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741bd3b-220b-4131-a3cf-00c822ec7b64 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:50.006647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:50.007602 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.008778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.008994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] PATH_INFO: `/v3/users/90269e8be13b4ac1bcb21162cf6d4555` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.010367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90269e8be13b4ac1bcb21162cf6d4555)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:50.013340 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:50.077597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90269e8be13b4ac1bcb21162cf6d4555'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.078502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90269e8be13b4ac1bcb21162cf6d4555'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.087943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90269e8be13b4ac1bcb21162cf6d4555'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.088738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90269e8be13b4ac1bcb21162cf6d4555'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.098956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-13291029-1594-4e92-8f71-b203ce4b5c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90269e8be13b4ac1bcb21162cf6d4555'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.122050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1223/2496] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:49 2022] DELETE /identity/v3/users/90269e8be13b4ac1bcb21162cf6d4555 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:50.512630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:50.514904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:50.543880 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a1f7-1e3a-432e-add4-a130b3f94638 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:50.610667 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:50.612483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.612956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.613629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] PATH_INFO: `/v3/projects/4d84a9c874d44926955b9945452e09ac` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.615815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d84a9c874d44926955b9945452e09ac)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:50.618872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:50.689493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d84a9c874d44926955b9945452e09ac', 'request_id': 'req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.699014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d84a9c874d44926955b9945452e09ac', 'request_id': 'req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.711003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d84a9c874d44926955b9945452e09ac', 'request_id': 'req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.728677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] The token cache is being invalidate because project 4d84a9c874d44926955b9945452e09ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:50.729139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.730158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-c8c51bc4-04ea-4d25-afa3-62d4f4dc30c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:50.733194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1274/2497] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:50 2022] DELETE /identity/v3/projects/4d84a9c874d44926955b9945452e09ac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:50.738472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.738905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.739422 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.761179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:50.763984 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:50.845444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1224/2498] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:59:50.859339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.859982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.860468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.889134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:50.891259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:50.910490 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1275/2499] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:50.916203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:50.929770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b7dae-ba0a-420b-b0a9-1fa2340afcec None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:50.934938 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:50.935716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.935979 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.936253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.937007 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:59:50.937989 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:50.939720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:50.952893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1225/2500] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 14:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:59:50.958479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:50.973392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b68f-4471-403e-9c22-4ad4832e7372 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:50.980236 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:50.980928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:50.981212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:50.981492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:50.982234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:50.984317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.029651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1276/2501] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:50 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:51.034139 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.050466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9215-8f6a-4523-ac04-2ce039217ebb admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.126913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.128244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.129912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.130555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.132130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.135951 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.168776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1226/2502] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:51 2022] POST /identity/v3/users => generated 305 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:51.175893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.195331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92caa1b-0a4b-4839-a2c4-b679aebc7db5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.203870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.205032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.205546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.206023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.207452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.210767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.237613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1277/2503] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:51.240076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.261759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dee70-6d9e-43e9-8372-7d8b09f9a104 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.273682 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.275824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.276616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.277333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.296442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.299465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b719f-23eb-4be4-be4c-d0fe3f222643 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.317204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1227/2504] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:51.324080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.350186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277369-03c9-45e7-ba61-c012726987a2 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.359746 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.361422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.362036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.362618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] PATH_INFO: `/v3/projects/f8196b711b2b40fca1323c4595de5314/users/de4120a03c1245aeb54d2e16a232538f/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.393773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8196b711b2b40fca1323c4595de5314, user_id=de4120a03c1245aeb54d2e16a232538f, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.397472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.414551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1278/2505] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:51 2022] PUT /identity/v3/projects/f8196b711b2b40fca1323c4595de5314/users/de4120a03c1245aeb54d2e16a232538f/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:59:51.428040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.428533 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.428935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.470675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] MFA Rules not processed for user `de4120a03c1245aeb54d2e16a232538f`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:51.473467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:51.581685 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1228/2506] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:51.587464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.686032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477312-a0ec-457f-9480-3e81a38eed1a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.691267 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.692016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.692300 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.692573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.693563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.695755 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.730465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1279/2507] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 14:59:51 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:59:51.734565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.746598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3c47-1d82-4cc9-b39a-168214dfa733 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.851826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.852559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.853117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.853117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.853928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.857391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.888217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1229/2508] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 14:59:51 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:59:51.895553 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.914521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bb3ab-4b1d-4a95-9529-cd83ac7ef090 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.920481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.921169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.921464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.921727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.922475 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.924166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:51.936419 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1280/2509] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:51.941032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:51.952209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a683-d77b-4759-91dc-72959c6921a8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:51.958395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:51.959619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:51.960003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:51.960367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] PATH_INFO: `/v3/projects/63ad3bdf49c44a4191312e62522e0417/users/34c93fd3812b4eb892e0afa900e43db9/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:51.986513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ad3bdf49c44a4191312e62522e0417, user_id=34c93fd3812b4eb892e0afa900e43db9, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:51.989655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:52.010179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1230/2510] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:51 2022] PUT /identity/v3/projects/63ad3bdf49c44a4191312e62522e0417/users/34c93fd3812b4eb892e0afa900e43db9/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:52.015381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:52.030273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6b67-b1cc-4ef6-90b3-6c8dea60ee85 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:52.100353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:52.101170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:52.101577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:52.101926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:52.103128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:52.105115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f09f0-681e-4236-9e7a-a831b470082e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:52.120188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1281/2511] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 14:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:59:52.126015 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:52.139328 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0ff3-ffa7-46fd-91dd-46cc4731ecd0 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:52.145160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:52.146583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:52.146937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:52.147296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] PATH_INFO: `/v3/projects/63ad3bdf49c44a4191312e62522e0417/users/34c93fd3812b4eb892e0afa900e43db9/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:52.149928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ad3bdf49c44a4191312e62522e0417, user_id=34c93fd3812b4eb892e0afa900e43db9, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:52.153008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:52.171136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1231/2512] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 14:59:52 2022] PUT /identity/v3/projects/63ad3bdf49c44a4191312e62522e0417/users/34c93fd3812b4eb892e0afa900e43db9/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:52.182937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:52.183231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:52.183467 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:52.214928 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] MFA Rules not processed for user `34c93fd3812b4eb892e0afa900e43db9`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:52.216321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:52.308566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1282/2513] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:59:52.322482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:52.326646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:52.403858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a8dd-7284-48eb-b201-3bae7b3e712c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:52.407484 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:52.408174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:52.408445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:52.408712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:52.419402 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:52.420912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:52.431862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1232/2514] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:59:52.655626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:52.666502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057f2b2-3d4d-4335-aed9-d68f3773974a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:52.671252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:52.671943 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:52.672215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:52.672558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:52.740221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:52.741849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:52.752631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1283/2515] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:55.731258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:55.732999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:55.806613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2d9c-00c0-46ee-8e63-b6f6d8e6915d service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:55.810987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:55.811846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:55.812285 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:55.812653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:55.814866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:55.892627 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:55.895444 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891af36b-a061-413d-b06f-1da0cb0ff4a5 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:55.915386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1233/2516] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:59:58.393722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:58.411107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417e221-bd6d-43f9-9a8e-5f3e43364965 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:58.417129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:58.418121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:58.418534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:58.418874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] PATH_INFO: `/v3/users/de4120a03c1245aeb54d2e16a232538f` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:58.420406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4120a03c1245aeb54d2e16a232538f)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:58.422679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:58.491265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4120a03c1245aeb54d2e16a232538f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:58.501829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4120a03c1245aeb54d2e16a232538f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:58.511221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4120a03c1245aeb54d2e16a232538f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:58.530152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4120a03c1245aeb54d2e16a232538f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:58.531072 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4120a03c1245aeb54d2e16a232538f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:58.544738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1284/2517] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:58 2022] DELETE /identity/v3/users/de4120a03c1245aeb54d2e16a232538f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:58.551310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:58.552170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:58.552170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:58.571493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:59:58.572728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:58.658550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1234/2518] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:59:58.672474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:58.683181 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:58.758922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6dbe1-cf0b-4eaf-9a47-30ccd0150b14 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:58.765472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:58.766693 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:58.767247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:58.767829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:58.784278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:58.786477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:58.800225 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1285/2519] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:59:59.172158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:59.175581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:59:59.203040 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793428e-5167-4179-8fa5-6b8067f03cde None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:59.212268 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:59.214395 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:59.216174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:59.216878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] PATH_INFO: `/v3/projects/f8196b711b2b40fca1323c4595de5314` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:59.220654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8196b711b2b40fca1323c4595de5314)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:59.224962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:59.287312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8196b711b2b40fca1323c4595de5314', 'request_id': 'req-ef3884e4-e309-462c-8d29-f74c70e490cd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.295172 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8196b711b2b40fca1323c4595de5314', 'request_id': 'req-ef3884e4-e309-462c-8d29-f74c70e490cd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.307693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8196b711b2b40fca1323c4595de5314', 'request_id': 'req-ef3884e4-e309-462c-8d29-f74c70e490cd'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.332233 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] The token cache is being invalidate because project f8196b711b2b40fca1323c4595de5314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:59:59.332646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.333953 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.336165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1235/2520] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 14:59:59 2022] DELETE /identity/v3/projects/f8196b711b2b40fca1323c4595de5314 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:59.340413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:59.354391 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895ed4-aa89-4a2c-8a7a-9176691789c3 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:59:59.420423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:59:59.421232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:59:59.421534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:59:59.421845 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] PATH_INFO: `/v3/users/34c93fd3812b4eb892e0afa900e43db9` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:59:59.423243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c93fd3812b4eb892e0afa900e43db9)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:59:59.425279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:59:59.500904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c93fd3812b4eb892e0afa900e43db9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.515798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c93fd3812b4eb892e0afa900e43db9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.537379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c93fd3812b4eb892e0afa900e43db9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.564272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c93fd3812b4eb892e0afa900e43db9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.565228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c93fd3812b4eb892e0afa900e43db9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:59:59.580413 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1286/2521] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:59 2022] DELETE /identity/v3/users/34c93fd3812b4eb892e0afa900e43db9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:59:59.979060 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:59:59.980625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.007393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3884e4-e309-462c-8d29-f74c70e490cd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.076584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.077656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.078048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.078262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] PATH_INFO: `/v3/users/a440a1183fca4565a84e009d99acf813` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.079770 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a440a1183fca4565a84e009d99acf813)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.081846 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.139018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a440a1183fca4565a84e009d99acf813'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.139753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a440a1183fca4565a84e009d99acf813'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.141620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.143145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.148433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a440a1183fca4565a84e009d99acf813'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.149147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a440a1183fca4565a84e009d99acf813'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.158609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd307-177d-4c61-b579-40a589479d7c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.160503 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c5e4d75e-d2ca-440d-b647-080c27b4e950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a440a1183fca4565a84e009d99acf813'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.174821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.176437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.176959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.177457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] PATH_INFO: `/v3/projects/63ad3bdf49c44a4191312e62522e0417` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.179812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ad3bdf49c44a4191312e62522e0417)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.184697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.187199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1236/2522] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 14:59:59 2022] DELETE /identity/v3/users/a440a1183fca4565a84e009d99acf813 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:00.251392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ad3bdf49c44a4191312e62522e0417', 'request_id': 'req-7b325311-072f-4371-91dd-d345655e49d9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.259062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ad3bdf49c44a4191312e62522e0417', 'request_id': 'req-7b325311-072f-4371-91dd-d345655e49d9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.275373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ad3bdf49c44a4191312e62522e0417', 'request_id': 'req-7b325311-072f-4371-91dd-d345655e49d9'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.288450 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] The token cache is being invalidate because project 63ad3bdf49c44a4191312e62522e0417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:00.288733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.289434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.291040 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1287/2523] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:00 2022] DELETE /identity/v3/projects/63ad3bdf49c44a4191312e62522e0417 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:00.296759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d609-fca8-4c9f-a69d-2527eae09918 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.297080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d609-fca8-4c9f-a69d-2527eae09918 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.297345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d609-fca8-4c9f-a69d-2527eae09918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.318517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d130d609-fca8-4c9f-a69d-2527eae09918 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:00.319826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d130d609-fca8-4c9f-a69d-2527eae09918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.393489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1237/2524] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:00.397787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.399549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.402742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.403344 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.403621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.416339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b325311-072f-4371-91dd-d345655e49d9 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.423161 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:00.423652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.424510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.426170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.426170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.426170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] PATH_INFO: `/v3/projects/6e512012e71544cc9fa1a2853ee7cc51` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.427585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e512012e71544cc9fa1a2853ee7cc51)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.429921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.434895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1238/2525] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:00.439573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.452619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8e36-5d86-4db2-b9cf-c643e4db293a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.459962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.461052 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.461371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.461718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.462505 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:00.462818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.464572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.478666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1239/2526] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:00.483349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.494081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434af04c-a2fa-4880-be11-e8f146fb4b58 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.495800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e512012e71544cc9fa1a2853ee7cc51', 'request_id': 'req-7d98bad4-03c2-451c-8270-b185253fbc5f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.503578 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e512012e71544cc9fa1a2853ee7cc51', 'request_id': 'req-7d98bad4-03c2-451c-8270-b185253fbc5f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.512289 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e512012e71544cc9fa1a2853ee7cc51', 'request_id': 'req-7d98bad4-03c2-451c-8270-b185253fbc5f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.523546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] The token cache is being invalidate because project 6e512012e71544cc9fa1a2853ee7cc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:00.523857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.524509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7d98bad4-03c2-451c-8270-b185253fbc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:00.526054 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1288/2527] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:00 2022] DELETE /identity/v3/projects/6e512012e71544cc9fa1a2853ee7cc51 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:00.531417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba125-bdda-4781-9b6d-aa356d254e5d None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.531705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba125-bdda-4781-9b6d-aa356d254e5d None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.531981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba125-bdda-4781-9b6d-aa356d254e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.551291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-895ba125-bdda-4781-9b6d-aa356d254e5d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:00.552527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-895ba125-bdda-4781-9b6d-aa356d254e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.557009 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.557694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.557971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.558243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.559043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.560650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1289/2528] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:00.561217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.569851 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.570465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.570742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.591596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:00.592112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1240/2529] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:00.592966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.597771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.599458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.661751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1290/2530] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:00.666131 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.676708 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282bb0-278b-4e19-95a1-6214e4314c26 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.679095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f3ee-07f5-49f2-9081-e5e55fff5b12 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.681837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.682513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.682795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.683096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.683878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:00.684192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.685847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.686915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.687752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.688236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.688791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.690008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.693778 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.700344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1291/2531] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:00.704750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.716380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb26f0-6e54-4db8-a506-dce2cc02c44a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.721393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.722062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.722367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.722643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.723350 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.724265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1241/2532] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:00.725328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.730264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.741286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad76814-2d16-49fe-a1cc-e7fb121e881d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.746956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.747635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.747962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.748377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.749134 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.750798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.758614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1292/2533] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:00.762034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1242/2534] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:00.763211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.765882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.776746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126486-a59e-4623-aa77-4f6125f39e60 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.827581 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13396a-548f-4bb4-872f-752df2af87da admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.833001 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.833702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.834000 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.834275 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.834973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.837177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.837808 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.838843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.839120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.839391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.840278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.841964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.858752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1243/2535] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:00.863689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1293/2536] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:00.864918 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.869384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.878973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e2b-1fcc-453e-8dd7-f3c67b4b5062 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.880284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492b17-4091-4dc8-9da6-b3961998cdcd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.885527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.885970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.886789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.886789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.886789 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.887964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.888266 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.888472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.888472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] PATH_INFO: `/v3/projects/c42d4c72931a48bfb752880d2485aa5e/users/3cde043602c447a698755db772ddf7e1/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.889633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.901790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1294/2537] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:00.907473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:00.907871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42d4c72931a48bfb752880d2485aa5e, user_id=3cde043602c447a698755db772ddf7e1, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.910646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d6a6-7650-48aa-be2e-2dea094a4df1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:00.918452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781b8b-c921-475e-b212-ec0be8a3fecc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:00.925734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1244/2538] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:00 2022] PUT /identity/v3/projects/c42d4c72931a48bfb752880d2485aa5e/users/3cde043602c447a698755db772ddf7e1/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:00.936242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.936527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.936812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.974185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] MFA Rules not processed for user `3cde043602c447a698755db772ddf7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:00.975709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:00.992548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:00.993248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:00.993530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:00.993884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:00.994572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:00.996424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.007377 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1295/2539] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:01.013052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.026106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19463-6c06-48f4-8e09-99613f854edb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.032317 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.033426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.033780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.034061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] PATH_INFO: `/v3/projects/94cd4d427b4d4cb1a976381c8294b16b/users/bda8c32407d0420eb895d02a682b82b5/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.051890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cd4d427b4d4cb1a976381c8294b16b, user_id=bda8c32407d0420eb895d02a682b82b5, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.054813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222ea2a-ff6a-4180-bca2-5b417a4fdcd5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.069720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1296/2540] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:01 2022] PUT /identity/v3/projects/94cd4d427b4d4cb1a976381c8294b16b/users/bda8c32407d0420eb895d02a682b82b5/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:01.080799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.081144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.081956 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.099106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1245/2541] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:01.105582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.124238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919da94-1e6e-447e-9939-541b078e4ba1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.132682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] MFA Rules not processed for user `bda8c32407d0420eb895d02a682b82b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:01.134879 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:01.197223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.199771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.200057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.200334 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.201046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.203092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.222548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1297/2542] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:01.234624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.236582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1246/2543] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:01.236725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:01.242826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.321066 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8dce2-585b-4b63-950b-b264fd9080ef None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.339186 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3dcf0-11b1-4a4c-a990-bd2e0de793fb admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.345797 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.346480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.346735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.347023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.347752 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.349834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.373403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1247/2544] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:01.377325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.387762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70e50-5672-468b-979f-7bbd3d6b2914 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.393949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.395173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.396182 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.396823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.397901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.398098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.398558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.398842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.399116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.401231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.419225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1248/2545] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:01.423699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.434526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebae4-140a-46ad-ab00-fece2d2826db admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.439750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.440425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.440708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.440983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.441718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.443359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.455297 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1249/2546] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:01.459710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.468603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.470606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3df268-d3a3-4851-9c93-38dc0c416f85 service nova] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.473851 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abfc5-f9cd-4e21-81b3-9babec031554 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.479045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.480044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.480317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.480573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] PATH_INFO: `/v3/projects/334f445673b74cd987e0b248ba2bdb88/users/58df0491fcef46168b94c2a4e0e46a8c/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.484508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1298/2547] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:01.502673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334f445673b74cd987e0b248ba2bdb88, user_id=58df0491fcef46168b94c2a4e0e46a8c, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.505429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.522875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1250/2548] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:01 2022] PUT /identity/v3/projects/334f445673b74cd987e0b248ba2bdb88/users/58df0491fcef46168b94c2a4e0e46a8c/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:01.538179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.538589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.538989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.581914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] MFA Rules not processed for user `58df0491fcef46168b94c2a4e0e46a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:01.584002 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:01.691865 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1299/2549] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:01.697276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.785035 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002380-ce7c-49ea-82d1-55584f3c6743 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.792904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.794382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.794382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.795054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.795988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.798018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.833826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1251/2550] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:01.838511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.859395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf43250-4d8a-4903-8fc8-ea855b717530 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.930909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.931601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.931911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.932196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.932900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.934875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:01.958059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1300/2551] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:01 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:01.962561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:01.980609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68c784-8931-4c94-861e-672ab6a21468 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:01.985731 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:01.986413 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:01.986697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:01.986971 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:01.987761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:01.989565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.003004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1252/2552] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:02.009500 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:02.027786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02378-9a9e-48a7-9e1c-f69eef50135e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:02.036748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:02.038343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.038840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.039326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] PATH_INFO: `/v3/projects/dff6d004e9774b849444977084427b07/users/59f5ecacd11d4f9ca7a509d98462b1ff/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.066794 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff6d004e9774b849444977084427b07, user_id=59f5ecacd11d4f9ca7a509d98462b1ff, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:02.072409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.095574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1301/2553] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:02 2022] PUT /identity/v3/projects/dff6d004e9774b849444977084427b07/users/59f5ecacd11d4f9ca7a509d98462b1ff/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:02.101138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:02.112379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110284-85f6-44cf-a7d1-c279ad33ee32 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:02.174247 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:02.174955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.175238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.175514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.176295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:02.177963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316ebc-16fc-47af-983c-17b504eab2d6 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.190781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1253/2554] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:02.195277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:02.206650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c529b-8879-4bfa-93e6-af1a15d344f0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:02.211656 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:02.212615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.212915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.213191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] PATH_INFO: `/v3/projects/dff6d004e9774b849444977084427b07/users/59f5ecacd11d4f9ca7a509d98462b1ff/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.215440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff6d004e9774b849444977084427b07, user_id=59f5ecacd11d4f9ca7a509d98462b1ff, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:02.218014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.230164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1302/2555] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:02 2022] PUT /identity/v3/projects/dff6d004e9774b849444977084427b07/users/59f5ecacd11d4f9ca7a509d98462b1ff/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:02.242287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.242582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.242874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.285857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] MFA Rules not processed for user `59f5ecacd11d4f9ca7a509d98462b1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:02.287403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:02.372013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1254/2556] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:02.384033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:02.386328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:02.453758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2cdc4-68ab-4cee-8ba9-a434875c6d07 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:02.459653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:02.460466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.460618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.460892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.475492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:02.477124 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.489145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1303/2557] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:02.547608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:02.549669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:02.564858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f305b-ce59-4956-922c-a59d6d94ba9c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:02.571982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:02.572981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:02.574171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:02.574171 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:02.648204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:02.649863 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b1d6-2c74-4474-b90a-b9f40d63132b service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:02.661083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1255/2558] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:05.698286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:05.772883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699800f5-6964-41bf-8068-6558a409700e service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:05.777729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:05.778591 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:05.778871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:05.779145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] PATH_INFO: `/v3/users/3cde043602c447a698755db772ddf7e1` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:05.780532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cde043602c447a698755db772ddf7e1)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:05.782634 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:05.850408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cde043602c447a698755db772ddf7e1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:05.859608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cde043602c447a698755db772ddf7e1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:05.868783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cde043602c447a698755db772ddf7e1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:05.883706 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cde043602c447a698755db772ddf7e1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:05.886523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cde043602c447a698755db772ddf7e1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:05.896734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1304/2559] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:05 2022] DELETE /identity/v3/users/3cde043602c447a698755db772ddf7e1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:05.904968 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:05.905540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:05.905540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:05.925787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:05.927203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:06.005504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1256/2560] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:06.015401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:06.016964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:06.093328 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400af34-75a1-4c8f-9c45-172f4f737f70 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:06.098712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:06.099401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:06.099788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:06.099999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:06.110994 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:06.112566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:06.124751 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1305/2561] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:06.476396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:06.480415 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:06.493279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24fcf5-e5e0-4796-8169-e77e288a4d7c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:06.499067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:06.500038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:06.500303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:06.500675 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] PATH_INFO: `/v3/projects/c42d4c72931a48bfb752880d2485aa5e` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:06.501885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42d4c72931a48bfb752880d2485aa5e)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:06.503891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:06.558843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42d4c72931a48bfb752880d2485aa5e', 'request_id': 'req-9a9c6b31-8486-448f-974e-f4ae1630fea0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.572235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42d4c72931a48bfb752880d2485aa5e', 'request_id': 'req-9a9c6b31-8486-448f-974e-f4ae1630fea0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.581314 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42d4c72931a48bfb752880d2485aa5e', 'request_id': 'req-9a9c6b31-8486-448f-974e-f4ae1630fea0'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.593769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] The token cache is being invalidate because project c42d4c72931a48bfb752880d2485aa5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:06.594481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.594735 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.596730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1257/2562] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:06 2022] DELETE /identity/v3/projects/c42d4c72931a48bfb752880d2485aa5e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:06.602643 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:06.613340 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03759e36-6bd4-4959-8a69-f86e708d1af8 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:06.686081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:06.687007 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:06.687269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:06.687535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] PATH_INFO: `/v3/users/58df0491fcef46168b94c2a4e0e46a8c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:06.688863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58df0491fcef46168b94c2a4e0e46a8c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:06.690911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:06.744541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58df0491fcef46168b94c2a4e0e46a8c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.761734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58df0491fcef46168b94c2a4e0e46a8c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.775904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58df0491fcef46168b94c2a4e0e46a8c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.789778 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58df0491fcef46168b94c2a4e0e46a8c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.790913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58df0491fcef46168b94c2a4e0e46a8c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:06.798624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1306/2563] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:06 2022] DELETE /identity/v3/users/58df0491fcef46168b94c2a4e0e46a8c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:06.934912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:06.936576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:06.954780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c6b31-8486-448f-974e-f4ae1630fea0 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:07.052882 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:07.054490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.055002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.055483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] PATH_INFO: `/v3/users/bda8c32407d0420eb895d02a682b82b5` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:07.057582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda8c32407d0420eb895d02a682b82b5)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:07.059616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:07.118280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda8c32407d0420eb895d02a682b82b5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.119331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda8c32407d0420eb895d02a682b82b5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.126807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda8c32407d0420eb895d02a682b82b5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.127871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda8c32407d0420eb895d02a682b82b5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.137313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-eee3332e-cf73-4ea2-a15b-10cb5d0a2863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda8c32407d0420eb895d02a682b82b5'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.162520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:07.162862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1258/2564] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:06 2022] DELETE /identity/v3/users/bda8c32407d0420eb895d02a682b82b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:07.167077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.168002 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.168367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.168726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:07.187018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89babdbf-77a6-48ae-bb74-93acf87a59c1 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:07.190644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:07.193554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.259923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1259/2565] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:07.263559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:07.264567 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.264842 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.265117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] PATH_INFO: `/v3/projects/334f445673b74cd987e0b248ba2bdb88` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:07.266368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] RBAC: Authorizing `identity:delete_project(project_id=334f445673b74cd987e0b248ba2bdb88)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:07.268327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:07.269693 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:07.271438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.320362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334f445673b74cd987e0b248ba2bdb88', 'request_id': 'req-5bd9ef0c-9b26-420b-88ee-3636ba47756f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.328228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334f445673b74cd987e0b248ba2bdb88', 'request_id': 'req-5bd9ef0c-9b26-420b-88ee-3636ba47756f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.340834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334f445673b74cd987e0b248ba2bdb88', 'request_id': 'req-5bd9ef0c-9b26-420b-88ee-3636ba47756f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.348458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c918-ecfb-4195-b808-ccb77a92533f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:07.354048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] The token cache is being invalidate because project 334f445673b74cd987e0b248ba2bdb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:07.354312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.354986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.356654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1307/2566] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:07 2022] DELETE /identity/v3/projects/334f445673b74cd987e0b248ba2bdb88 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:07.360695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:07.362166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.402027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:07.402855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.403214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.403491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:07.407477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.436341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9ef0c-9b26-420b-88ee-3636ba47756f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:07.442359 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:07.443401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.443847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.444233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] PATH_INFO: `/v3/users/59f5ecacd11d4f9ca7a509d98462b1ff` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:07.445680 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f5ecacd11d4f9ca7a509d98462b1ff)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:07.447897 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:07.515575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:07.518289 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:07.521382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f5ecacd11d4f9ca7a509d98462b1ff'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.533653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f5ecacd11d4f9ca7a509d98462b1ff'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.534331 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1260/2567] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:07.547472 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f5ecacd11d4f9ca7a509d98462b1ff'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.563939 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f5ecacd11d4f9ca7a509d98462b1ff'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.565024 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f5ecacd11d4f9ca7a509d98462b1ff'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:07.572053 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1308/2568] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:07 2022] DELETE /identity/v3/users/59f5ecacd11d4f9ca7a509d98462b1ff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:07.912085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:07.913577 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.926927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:07.927480 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487387-0c5d-40a0-ba28-211449aa0a42 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:07.929734 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:07.997867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:07.998978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:07.999265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:07.999541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] PATH_INFO: `/v3/projects/94cd4d427b4d4cb1a976381c8294b16b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.001049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cd4d427b4d4cb1a976381c8294b16b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.003077 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.053173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a77ea8-b3ba-4fa6-90aa-18531c908295 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.062531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cd4d427b4d4cb1a976381c8294b16b', 'request_id': 'req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.070254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cd4d427b4d4cb1a976381c8294b16b', 'request_id': 'req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.078223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cd4d427b4d4cb1a976381c8294b16b', 'request_id': 'req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.090419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] The token cache is being invalidate because project 94cd4d427b4d4cb1a976381c8294b16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:08.090704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.091374 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2c4f1649-e4d9-42b4-b0c4-57c4e76c8b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.093174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1261/2569] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:07 2022] DELETE /identity/v3/projects/94cd4d427b4d4cb1a976381c8294b16b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:08.097754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d61f-7a3c-472e-bbc4-6d843fa1a8d1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.098034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d61f-7a3c-472e-bbc4-6d843fa1a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.098400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d61f-7a3c-472e-bbc4-6d843fa1a8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.116761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.117645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.117922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.118194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] PATH_INFO: `/v3/projects/dff6d004e9774b849444977084427b07` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.119423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff6d004e9774b849444977084427b07)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.121560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ee44d61f-7a3c-472e-bbc4-6d843fa1a8d1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.121699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.123224 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ee44d61f-7a3c-472e-bbc4-6d843fa1a8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.138497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1262/2570] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:08.140750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.141087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.141309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.163269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.165096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.186937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff6d004e9774b849444977084427b07', 'request_id': 'req-1ee2cabb-538d-410e-9083-1ab23e9bd791'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.194760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff6d004e9774b849444977084427b07', 'request_id': 'req-1ee2cabb-538d-410e-9083-1ab23e9bd791'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.205230 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff6d004e9774b849444977084427b07', 'request_id': 'req-1ee2cabb-538d-410e-9083-1ab23e9bd791'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.226583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] The token cache is being invalidate because project dff6d004e9774b849444977084427b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:08.226949 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.228035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-1ee2cabb-538d-410e-9083-1ab23e9bd791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:08.231507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1309/2571] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:07 2022] DELETE /identity/v3/projects/dff6d004e9774b849444977084427b07 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:08.237952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4364-5c0d-4397-8e14-8fc74303e161 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.238277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4364-5c0d-4397-8e14-8fc74303e161 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.238519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4364-5c0d-4397-8e14-8fc74303e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.258436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-0e0f4364-5c0d-4397-8e14-8fc74303e161 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.259714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0e0f4364-5c0d-4397-8e14-8fc74303e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.271025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1263/2572] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:08.276206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.289017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee79908-744e-4818-a0fa-87414e7cb2a7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.295091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.296200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.296200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.296491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.297096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:08.297476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.299229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.313428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1264/2573] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:08.317568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.326823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1310/2574] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:08.329019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b4cb-0301-45fb-a07e-a592c59be18b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.335688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.335991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.336258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.337119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.339573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.340200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.340200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.341231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.344583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.356826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.358389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.367155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1311/2575] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:08.371568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.377460 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1265/2576] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:08.381782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.383276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c54c-8f05-4157-b6bc-0cf0dc502ad0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.450836 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaa4c-bf48-4479-a75c-18080e789e1d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.451764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.452452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.452736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.453011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.453745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:08.454051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.455799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.456153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.456830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.457114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.457383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.458532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.460213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.468545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1312/2577] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:08.476910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.492746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1266/2578] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:08.492963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe325c9-fdb1-40bb-b47b-3ffc295514e0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.493812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.497416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.498196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.498479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.498796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.499546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.501625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.504327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97908-93f2-49f7-953c-f68a75a69470 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.510454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.511223 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.511494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.511832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.512666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.514391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.526626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1267/2579] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:08.531379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.533583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1313/2580] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:08.538954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.543071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc516-cc7c-4d88-9c99-e3b38754e47b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.605963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c737e-18b6-4cdd-87a6-df8efbaec8ec admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.609911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.610581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.610784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.610902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.611108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.611483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.611791 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.611890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.612068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.612762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.613483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.614695 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.625412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1268/2581] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:08.630847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.644663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1314/2582] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/users => generated 281 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:08.644912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994aa7-6f06-4afa-8252-5a6b995bab1c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.646314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.647406 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.648393 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.648674 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.648956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] PATH_INFO: `/v3/projects/c969c702299c4f638624657d26a7e64d/users/1054a85e71a743ca8773df42939472fa/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.656878 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7ea9-7a62-4ad1-bf21-bd326bc3ba70 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.662511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.663187 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.663465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.663764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.664510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.666044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c969c702299c4f638624657d26a7e64d, user_id=1054a85e71a743ca8773df42939472fa, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.666193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.669018 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3757a4-7fae-4420-b922-c6f2ea11fa06 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.677857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1315/2583] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:08.682636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.696165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a051a0-6228-44c4-a3fd-842aadf623fc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.696653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1269/2584] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:08 2022] PUT /identity/v3/projects/c969c702299c4f638624657d26a7e64d/users/1054a85e71a743ca8773df42939472fa/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:08.711232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d7bf-dc92-41ea-80c1-01087d46a055 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.711822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d7bf-dc92-41ea-80c1-01087d46a055 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.712282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766d7bf-dc92-41ea-80c1-01087d46a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.749623 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-7766d7bf-dc92-41ea-80c1-01087d46a055 None None] MFA Rules not processed for user `1054a85e71a743ca8773df42939472fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.752112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-7766d7bf-dc92-41ea-80c1-01087d46a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.761826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.762518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.762801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.763061 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.763873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.765675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.777403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1316/2585] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:08.783709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.796170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084555c6-328d-41ac-bf51-4467264c572e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.801293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.802203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.802481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.802773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] PATH_INFO: `/v3/projects/f647ba4819c24e4389d83b2b79c9c471/users/f4564aaf296947feb4dba3cb03b89c3a/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.825820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647ba4819c24e4389d83b2b79c9c471, user_id=f4564aaf296947feb4dba3cb03b89c3a, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.829211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.846707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1317/2586] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:08 2022] PUT /identity/v3/projects/f647ba4819c24e4389d83b2b79c9c471/users/f4564aaf296947feb4dba3cb03b89c3a/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:08.852207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1270/2587] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:08.858027 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.858748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.859210 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.859690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.898271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] MFA Rules not processed for user `f4564aaf296947feb4dba3cb03b89c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:08.899694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:08.933161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f99d7-4889-41f2-bba4-42b34b3fb33b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:08.938675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:08.939368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:08.939617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:08.939944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:08.940650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:08.942626 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:08.968049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1271/2588] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:08.975762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1318/2589] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:08.980238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:08.992381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7714-3cb1-4d12-8c05-712591c250ae None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.008264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.010394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.053550 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.054382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.054532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.054805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.055513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.057539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.072274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a976-b536-4026-80d7-3b5d81a61c90 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.076244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.076869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.077155 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.077416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.080683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1272/2590] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:08 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:09.084853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.095159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14ba6-a10f-4a69-ab68-c6c57db501ff admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.100616 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.101298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.101651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.102011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.102842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.104668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.116187 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1273/2591] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:09.120514 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.130164 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0391ad-5e4a-4b74-b583-070594a5b50c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.134894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.135791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.136067 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.136336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] PATH_INFO: `/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d/users/8bdd795c357646b095daf0e953b53a22/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.152643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa94dd51ba49279cbe0d60cdea641d, user_id=8bdd795c357646b095daf0e953b53a22, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.155368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.157855 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.159306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.170093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1319/2592] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:09.173185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1274/2593] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:09 2022] PUT /identity/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d/users/8bdd795c357646b095daf0e953b53a22/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:09.177654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.185672 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.191881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87283c4c-37db-4caf-9128-c35e654c3ed8 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.251797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.252549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.253004 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.253362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.254265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.255567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f8d44-b0fb-480f-8a47-81bd234cfc96 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.256326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.260379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.261238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.261504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.261806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] PATH_INFO: `/v3/users/f4564aaf296947feb4dba3cb03b89c3a` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.263003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4564aaf296947feb4dba3cb03b89c3a)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.264957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.269683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1320/2594] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:09.271174 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.280975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4362-817a-408c-8c12-aaf35f07091a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.286429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.288003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.288003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.288003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] PATH_INFO: `/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d/users/8bdd795c357646b095daf0e953b53a22/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.290510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa94dd51ba49279cbe0d60cdea641d, user_id=8bdd795c357646b095daf0e953b53a22, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.293824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768202-0acf-4e94-b1fe-00639cd0e043 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.309368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1321/2595] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:09 2022] PUT /identity/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d/users/8bdd795c357646b095daf0e953b53a22/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:09.319106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4564aaf296947feb4dba3cb03b89c3a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:09.319333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.319333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.319493 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.319601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4564aaf296947feb4dba3cb03b89c3a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:09.328104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4564aaf296947feb4dba3cb03b89c3a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:09.330081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4564aaf296947feb4dba3cb03b89c3a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:09.341818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-c667ccbe-d7d1-44c1-9c1b-f1d2068adf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4564aaf296947feb4dba3cb03b89c3a'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:09.351654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] MFA Rules not processed for user `8bdd795c357646b095daf0e953b53a22`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:09.352484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.362662 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1275/2596] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:09 2022] DELETE /identity/v3/users/f4564aaf296947feb4dba3cb03b89c3a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:09.367041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47758-c214-4568-b40b-44137592df9d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.367327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47758-c214-4568-b40b-44137592df9d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.367612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47758-c214-4568-b40b-44137592df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.388303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cfa47758-c214-4568-b40b-44137592df9d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:09.389556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cfa47758-c214-4568-b40b-44137592df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.426780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1322/2597] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:09.427647 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.429013 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.450510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1276/2598] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:09.451599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47758-c214-4568-b40b-44137592df9d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.453128 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cfa47758-c214-4568-b40b-44137592df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.486093 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d769-b1d3-4cbc-b26c-23138ff4291e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.510450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47758-c214-4568-b40b-44137592df9d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.514759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.515144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.515365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.515639 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.541713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.542421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.542711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.543401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.545259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.559380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.560912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.572731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1323/2599] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:09.574074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.581759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.583282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.583461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5b31-d92d-40ae-b049-b2b2a029fe7f service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.590258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.590920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.591185 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.591457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.594917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1277/2600] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:09.606531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.610354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.630980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1324/2601] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:09.661555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:09.662988 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.675859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ea99-069c-4844-b642-5c02687f587b service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:09.680029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:09.680660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:09.681030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:09.681318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:09.683362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:09.750711 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:09.752239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc67fde-d3f1-4da5-b8d5-b9214b57fd42 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:09.762342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1278/2602] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:10.308325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.309971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:10.323032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701c10-62e3-441d-ae39-4e2aaedf50a6 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.329003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.329921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.330201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.330474 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] PATH_INFO: `/v3/projects/f647ba4819c24e4389d83b2b79c9c471` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.332089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f647ba4819c24e4389d83b2b79c9c471)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.333984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.388835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f647ba4819c24e4389d83b2b79c9c471', 'request_id': 'req-b2f7db5a-a32a-45b1-8487-c521bce46ba0'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:10.397118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f647ba4819c24e4389d83b2b79c9c471', 'request_id': 'req-b2f7db5a-a32a-45b1-8487-c521bce46ba0'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:10.406720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f647ba4819c24e4389d83b2b79c9c471', 'request_id': 'req-b2f7db5a-a32a-45b1-8487-c521bce46ba0'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:10.419068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] The token cache is being invalidate because project f647ba4819c24e4389d83b2b79c9c471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:10.419353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:10.420046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b2f7db5a-a32a-45b1-8487-c521bce46ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:10.421613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1325/2603] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:10 2022] DELETE /identity/v3/projects/f647ba4819c24e4389d83b2b79c9c471 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:10.426683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.427200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.427200 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.444379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:10.445560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:10.512596 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1279/2604] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:10.521711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.523043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.523043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.543237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:10.544543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:10.553484 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1326/2605] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:10.557906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.568076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea493-fc39-4fbd-83dd-bd00b4e1cc2f None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.573087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.573976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.573976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.574231 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.574957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:10.575257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.576990 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.596520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1280/2606] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:10.598636 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.608194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892c42-221b-4b9b-999c-76e040dc4604 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.612783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.613447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.613723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.613991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.614705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.616630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.644970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1327/2607] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:10 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:10.650255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.661917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8dc00-9bee-418d-a945-95e4b2c9f7b8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.727798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.728839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.729342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.731750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.731750 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.732506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.758992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1281/2608] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:10 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:10.763438 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.775549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126aa9-0493-4021-8361-663fe9d59081 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.782888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.783736 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.783963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.784310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.785026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.786725 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.798265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1328/2609] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:10.802434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.813244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41543622-26d2-4d7c-bf30-21ea768afb35 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.819309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.819309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.819309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.819580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.820273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.821898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfe7fb-c071-4e0e-a50b-afe785834966 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.833253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1282/2610] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:10.837829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:10.857161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155aed-f4cf-4f59-abd0-2192cfff1ad4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:10.864081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:10.865704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.866220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.866908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] PATH_INFO: `/v3/projects/2d7c3911161849aba0bbe034acbe48ef/users/88f9dc2bce7a45ec8cea989354b45c94/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.894105 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7c3911161849aba0bbe034acbe48ef, user_id=88f9dc2bce7a45ec8cea989354b45c94, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:10.898062 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:10.919711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1329/2611] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:10 2022] PUT /identity/v3/projects/2d7c3911161849aba0bbe034acbe48ef/users/88f9dc2bce7a45ec8cea989354b45c94/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:10.927506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:10.927845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:10.928129 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:10.958952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] MFA Rules not processed for user `88f9dc2bce7a45ec8cea989354b45c94`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:10.960280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:11.031739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1283/2612] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:11.036702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.105188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac170-d157-4e51-ad78-1bb6a525c6c8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.110713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.111411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.111694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.111993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.112701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.114691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.147717 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1330/2613] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:11 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:11.151753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.175506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b789d39-3d5f-4b90-ba1e-d0939d6d01b5 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.247091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.247937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.248286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.248566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.249266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.251238 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.279005 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1284/2614] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:11 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:11.280073 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.290849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee89e73-cb1e-4059-9113-f87bdb96c44e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.296097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.296749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.297017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.297428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.298154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.299776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.313065 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1331/2615] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:11.320349 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.329179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49259e0-6866-4886-ab48-064a9d34ee65 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.338722 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.339624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.340021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.340294 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] PATH_INFO: `/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7/users/64894f67b9814acb8422a2974b508818/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.356472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3f50d6124b425db6c8e7e5b26625b7, user_id=64894f67b9814acb8422a2974b508818, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.359135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.379207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.380136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1285/2616] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:11 2022] PUT /identity/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7/users/64894f67b9814acb8422a2974b508818/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:11.390398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016abb-036d-434f-8c9d-2132c36a0b11 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.463392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.464342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.464704 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.465090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.465932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.467919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30770598-6c18-436d-b6b1-b40db950b8e7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.479090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1332/2617] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:11.483609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.495656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68d5e6-b9ae-460d-956a-c8a77f0676b5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.501280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.502384 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.502720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.503275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] PATH_INFO: `/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7/users/64894f67b9814acb8422a2974b508818/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.505716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3f50d6124b425db6c8e7e5b26625b7, user_id=64894f67b9814acb8422a2974b508818, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.508561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.519766 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1286/2618] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:11 2022] PUT /identity/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7/users/64894f67b9814acb8422a2974b508818/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:11.530507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.530817 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.531355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.569899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] MFA Rules not processed for user `64894f67b9814acb8422a2974b508818`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:11.569899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:11.666827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1333/2619] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:11.677038 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:11.679027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:11.760723 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ecdc-45b8-444c-adf7-5e8cf3f181f2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:11.775082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:11.775798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:11.776082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:11.776353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:11.870867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:11.872551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:11.883054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1287/2620] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:13.352361 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:13.358901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:13.503332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96446-4bb9-479e-9add-f2a6cbabeaea None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:13.515036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:13.515036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:13.515036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:13.515036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] PATH_INFO: `/v3/users/1054a85e71a743ca8773df42939472fa` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:13.516750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1054a85e71a743ca8773df42939472fa)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:13.518186 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:13.588818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1054a85e71a743ca8773df42939472fa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.597895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1054a85e71a743ca8773df42939472fa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.606793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1054a85e71a743ca8773df42939472fa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.627407 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1054a85e71a743ca8773df42939472fa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.628452 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-93ea2269-7b8b-4f5b-94d4-872a6ea23496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1054a85e71a743ca8773df42939472fa'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.634630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:13.636236 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:13.654373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1334/2621] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:13 2022] DELETE /identity/v3/users/1054a85e71a743ca8773df42939472fa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:13.657218 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9625-0399-4951-bcc3-ff1d5ac17021 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:13.659563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:13.659714 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:13.659981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:13.680354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:13.681605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:13.725483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:13.726330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:13.726625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:13.726896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] PATH_INFO: `/v3/users/f0fc4ec8d3884e679cf6fe690a191b8b` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:13.728131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0fc4ec8d3884e679cf6fe690a191b8b)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:13.730087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:13.747427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1335/2622] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:13.757665 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:13.759356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:13.782520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0fc4ec8d3884e679cf6fe690a191b8b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.784212 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0fc4ec8d3884e679cf6fe690a191b8b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.794638 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0fc4ec8d3884e679cf6fe690a191b8b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.795407 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0fc4ec8d3884e679cf6fe690a191b8b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.804897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0fc4ec8d3884e679cf6fe690a191b8b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:13.823265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb6e3f-0f1b-410a-b0e9-cd33afa9152b None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:13.824453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1288/2623] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:13 2022] DELETE /identity/v3/users/f0fc4ec8d3884e679cf6fe690a191b8b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:13.889123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:13.889793 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:13.890261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:13.890547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:13.892727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:13.964012 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:13.965551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184567d-23b7-43ee-ad16-b6fe8498703a service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:13.976534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1336/2624] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:14.045309 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.046947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.060827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae923d-2363-459d-a7c0-ba7165ea0973 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.068257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.068866 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.069147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.069470 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] PATH_INFO: `/v3/projects/17dafc77bc7444f5888246fac0a1c999` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.071065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17dafc77bc7444f5888246fac0a1c999)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.073170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.141900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17dafc77bc7444f5888246fac0a1c999', 'request_id': 'req-5c088a4f-b93a-4290-8d60-20920515be91'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.148568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17dafc77bc7444f5888246fac0a1c999', 'request_id': 'req-5c088a4f-b93a-4290-8d60-20920515be91'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.164442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17dafc77bc7444f5888246fac0a1c999', 'request_id': 'req-5c088a4f-b93a-4290-8d60-20920515be91'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.175209 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] The token cache is being invalidate because project 17dafc77bc7444f5888246fac0a1c999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:14.175436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.176258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5c088a4f-b93a-4290-8d60-20920515be91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.177991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1289/2625] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:14 2022] DELETE /identity/v3/projects/17dafc77bc7444f5888246fac0a1c999 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:14.184894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.185112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.185382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.206401 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:14.207998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.270212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1337/2626] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:14.278862 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.279152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.279432 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.298143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:14.299390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.306650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.308287 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.312454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1290/2627] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:14.316497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.325631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e955cb-d34e-4e55-b023-4cfd2bca1bda None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.338057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.338955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.339213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.339487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] PATH_INFO: `/v3/projects/c969c702299c4f638624657d26a7e64d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.340551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912fb1-d348-4f02-8c3d-bc657557130e None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.341411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c969c702299c4f638624657d26a7e64d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.343418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.345474 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.346137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.346420 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.346688 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.347425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:14.347769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.349394 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.365057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1291/2628] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:14.366358 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.377277 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a7bb-3d10-4f6b-aa86-c993e6bf135f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.381956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.382599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.382949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.383142 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.383859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.385761 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.395198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c969c702299c4f638624657d26a7e64d', 'request_id': 'req-6241081b-21a1-4007-8de9-6da921e78a75'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.407691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c969c702299c4f638624657d26a7e64d', 'request_id': 'req-6241081b-21a1-4007-8de9-6da921e78a75'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.415996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c969c702299c4f638624657d26a7e64d', 'request_id': 'req-6241081b-21a1-4007-8de9-6da921e78a75'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.416877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1292/2629] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:14.421192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.428483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] The token cache is being invalidate because project c969c702299c4f638624657d26a7e64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:14.428779 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.429716 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.431342 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1338/2630] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:14 2022] DELETE /identity/v3/projects/c969c702299c4f638624657d26a7e64d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:14.435613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.436780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.487816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a3a8-4a56-4b4c-a518-b9f4ea946de8 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.493673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.494357 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.494669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.494962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.495694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.497667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.506045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241081b-21a1-4007-8de9-6da921e78a75 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.511890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.512836 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.513118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.513400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] PATH_INFO: `/v3/users/8bdd795c357646b095daf0e953b53a22` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.514863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdd795c357646b095daf0e953b53a22)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.517011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.519854 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1293/2631] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:14.524248 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.526222 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.541031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714f42-8b08-4239-8dd7-1d3cf00f162d admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.546608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.547423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.547553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.547876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.548713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.550323 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.565130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1294/2632] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:14.566923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.571311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdd795c357646b095daf0e953b53a22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.580064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84454-08eb-495c-8c80-3d02f9934d26 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.582561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdd795c357646b095daf0e953b53a22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.585944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.587359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.587648 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.587957 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.588732 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.590554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.593070 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdd795c357646b095daf0e953b53a22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.602252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1295/2633] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:14.607043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.619949 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17783-d3a6-4fa1-9255-2cf1e09e77cb admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.620434 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdd795c357646b095daf0e953b53a22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.622121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdd795c357646b095daf0e953b53a22'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.630047 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.631027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.631399 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.631868 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] PATH_INFO: `/v3/projects/eccca2ea6e12496dafb40b7980590bfb/users/80ecbcd257824804b7528e0b15afb92f/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.638477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1339/2634] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:14 2022] DELETE /identity/v3/users/8bdd795c357646b095daf0e953b53a22 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:14.638477 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.645428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.650713 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccca2ea6e12496dafb40b7980590bfb, user_id=80ecbcd257824804b7528e0b15afb92f, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.654234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ac63-c1ad-44ad-9d46-a61db35c5a21 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.675983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1296/2635] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:14 2022] PUT /identity/v3/projects/eccca2ea6e12496dafb40b7980590bfb/users/80ecbcd257824804b7528e0b15afb92f/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:14.682510 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.682827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.683859 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.714622 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:14.716119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.742813 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c585-fe6e-4d03-a7c9-30df066a5625 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.795760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1297/2636] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:14.805614 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.807485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.829130 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.834479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.834479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.834479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] PATH_INFO: `/v3/users/88f9dc2bce7a45ec8cea989354b45c94` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.836516 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f9dc2bce7a45ec8cea989354b45c94)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.839752 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.893867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ba58-a02b-4453-b19e-9cb4c916cc50 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:14.898714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:14.899398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.899683 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.899973 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.907252 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f9dc2bce7a45ec8cea989354b45c94'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.912119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:14.913913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408733e7-4de7-4960-901b-a6a060fe952e service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:14.918132 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f9dc2bce7a45ec8cea989354b45c94'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.925538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1298/2637] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:14.930682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f9dc2bce7a45ec8cea989354b45c94'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.945733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f9dc2bce7a45ec8cea989354b45c94'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.946683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f9dc2bce7a45ec8cea989354b45c94'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:14.958910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1340/2638] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:14 2022] DELETE /identity/v3/users/88f9dc2bce7a45ec8cea989354b45c94 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:14.959592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:14.959889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:14.960059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:14.986822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:14.988230 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:14.996026 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:14.997884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.069226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1299/2639] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:15.079477 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.081059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.082771 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99897-31d4-4867-be85-40138d8b8a4a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.089318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.090410 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.090729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.091005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] PATH_INFO: `/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.092595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfa94dd51ba49279cbe0d60cdea641d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.095454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.170220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b934297-3b81-453f-a4f7-376360ad063c None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.171527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfa94dd51ba49279cbe0d60cdea641d', 'request_id': 'req-d9f5fc0e-49ba-4658-b2e1-89410f16623b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:15.180231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfa94dd51ba49279cbe0d60cdea641d', 'request_id': 'req-d9f5fc0e-49ba-4658-b2e1-89410f16623b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:15.191780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfa94dd51ba49279cbe0d60cdea641d', 'request_id': 'req-d9f5fc0e-49ba-4658-b2e1-89410f16623b'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:15.206143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] The token cache is being invalidate because project bcfa94dd51ba49279cbe0d60cdea641d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:15.206605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:15.207420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d9f5fc0e-49ba-4658-b2e1-89410f16623b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:15.209775 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1341/2640] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:14 2022] DELETE /identity/v3/projects/bcfa94dd51ba49279cbe0d60cdea641d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:15.218344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf85c-efab-494b-a74f-8af60bb50d74 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.218344 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf85c-efab-494b-a74f-8af60bb50d74 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.218709 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf85c-efab-494b-a74f-8af60bb50d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.234082 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.234670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.234965 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.235392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.237780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.243705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-313cf85c-efab-494b-a74f-8af60bb50d74 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:15.243705 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-313cf85c-efab-494b-a74f-8af60bb50d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.327043 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.328582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.331394 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1342/2641] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:15.339152 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.339492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.339825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.344004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1300/2642] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:15.363047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:15.364697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.375326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1343/2643] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:15.380412 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.392229 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf926239-d391-45c2-9417-f7a391d5a7a5 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.399594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.400912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.401213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.401494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.402613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:15.402913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.404707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.422561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1301/2644] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:15.428106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.440606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fed40-fe2e-421a-82d8-d543871cf26c None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.445854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.446519 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.446798 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.447071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.447828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.450113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.482465 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1344/2645] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:15.486948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.498439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c7df-c2fa-4a8b-b756-1a0f7baadc40 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.564019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.564795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.565253 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.565582 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.566367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.568466 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.588555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1302/2646] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:15.592889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.604154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c789d1-1150-4c2a-8615-505c6b2ba822 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.609663 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.610345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.610633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.610900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.611630 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.613285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.624455 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1345/2647] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:15.628556 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.638794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0f70-f093-464b-9265-927908ba2691 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.643448 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.644149 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.644427 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.644697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.645414 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.647342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13573-285c-4ec7-a3a7-f3f90ed001e4 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.661720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1303/2648] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:15.664982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.677796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed2bf-ae45-4774-add1-7aa2488ef5e5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.687157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.687277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.687481 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.687786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] PATH_INFO: `/v3/projects/5f2af59b512e4495b08666e22e39dd85/users/bc9a68ff18d34031bc026792d7f4ad85/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.708951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2af59b512e4495b08666e22e39dd85, user_id=bc9a68ff18d34031bc026792d7f4ad85, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.712034 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91229331-eb31-4a7f-9a51-5f7b1dc9b278 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.730129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1346/2649] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:15 2022] PUT /identity/v3/projects/5f2af59b512e4495b08666e22e39dd85/users/bc9a68ff18d34031bc026792d7f4ad85/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:15.742436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.742826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.743265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.773008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.773280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.773556 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.781580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] MFA Rules not processed for user `bc9a68ff18d34031bc026792d7f4ad85`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:15.782992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.806048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] MFA Rules not processed for user `80ecbcd257824804b7528e0b15afb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:15.807492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.885663 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1304/2650] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:15.886855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.888493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:15.894139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1347/2651] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:15.898876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:15.970720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8d2bf-5ca6-447e-a944-7a46d12a23bb None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.976729 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.978114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.978114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.978455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] PATH_INFO: `/v3/projects/2d7c3911161849aba0bbe034acbe48ef` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.979959 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7c3911161849aba0bbe034acbe48ef)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.983205 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:15.987589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777acd2-efbf-4fa2-ba0a-1f6e23fb6264 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:15.992749 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:15.993373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:15.993645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:15.993923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:15.994615 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:15.996692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.031871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1348/2652] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:15 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:16.033903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.036877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.037283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7c3911161849aba0bbe034acbe48ef', 'request_id': 'req-dce4564a-d1cc-4144-94c2-c030b84a6d31'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.043976 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7c3911161849aba0bbe034acbe48ef', 'request_id': 'req-dce4564a-d1cc-4144-94c2-c030b84a6d31'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.052454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7c3911161849aba0bbe034acbe48ef', 'request_id': 'req-dce4564a-d1cc-4144-94c2-c030b84a6d31'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.063894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] The token cache is being invalidate because project 2d7c3911161849aba0bbe034acbe48ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:16.064212 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.065127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.066964 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1305/2653] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:15 2022] DELETE /identity/v3/projects/2d7c3911161849aba0bbe034acbe48ef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:16.069085 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.070768 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.121120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bc5ef-886d-4565-b450-4aff6ff40af8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.126211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.126877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.127192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.127612 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.128370 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.130295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.139819 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4564a-d1cc-4144-94c2-c030b84a6d31 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.145030 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.146045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.146335 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.146607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.147304 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.149373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.162767 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1349/2654] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:16 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:16.163881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.165883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.177201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1306/2655] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:16 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:16.178398 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.180127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.192096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f794-f0a8-4742-9e7c-cd1a3268c42e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.245699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8790c-aeb2-45b8-947c-1677318d8d0c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.252959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.254246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.254683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.255158 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] PATH_INFO: `/v3/users/64894f67b9814acb8422a2974b508818` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.257195 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=64894f67b9814acb8422a2974b508818)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.260513 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.269081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.269855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.270193 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.270562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.271799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.273850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.299137 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1307/2656] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:16 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:16.300351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.315575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59de60-c42f-4bdf-bcee-a84ac157048c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.319145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64894f67b9814acb8422a2974b508818'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.326126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.326126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.326126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.326126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.326943 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.331889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.332091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64894f67b9814acb8422a2974b508818'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.342859 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64894f67b9814acb8422a2974b508818'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.345369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1308/2657] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:16.346545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.356970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64894f67b9814acb8422a2974b508818'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.357903 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64894f67b9814acb8422a2974b508818'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.359516 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee1c1-ae2d-4d08-ae03-7cde7834af68 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.364455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.365118 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.365397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.365673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.366411 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.369941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1350/2658] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:16 2022] DELETE /identity/v3/users/64894f67b9814acb8422a2974b508818 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:16.369941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.370203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.370303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.383409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1309/2659] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:16.387838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.390022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.403493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a372e6-f3d3-4778-b867-3fa76de5fe44 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.438169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161270-147f-42df-afec-d1891f23a8bf admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.443593 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.444629 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.444963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.445149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] PATH_INFO: `/v3/projects/6ccac0cde5e2433286ed1bd8a501759d/users/49097b839f034e56847deb66da1e7e12/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.462854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccac0cde5e2433286ed1bd8a501759d, user_id=49097b839f034e56847deb66da1e7e12, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.465566 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.477389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.478351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.478666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.478936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] PATH_INFO: `/v3/projects/47007237b6ab4cceace7cffa102cd0b4/users/d1bee8da21c045f49614af8229cc85f3/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.481786 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1351/2660] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:16 2022] PUT /identity/v3/projects/6ccac0cde5e2433286ed1bd8a501759d/users/49097b839f034e56847deb66da1e7e12/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:16.486426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.498183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47007237b6ab4cceace7cffa102cd0b4, user_id=d1bee8da21c045f49614af8229cc85f3, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.501245 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.521592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1310/2661] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:16 2022] PUT /identity/v3/projects/47007237b6ab4cceace7cffa102cd0b4/users/d1bee8da21c045f49614af8229cc85f3/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:16.528709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.591035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbce3-8a2a-4657-996e-01b5951e47d7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.624944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59e06-9616-4253-bdfa-1c1252c80053 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.630670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.631502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.631826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.632102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.632839 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.634489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.649900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1311/2662] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:16.651177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.662711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.663270 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c344-12ad-45f5-acfb-001bfb3e4bf5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.663807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.663807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.663977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.664686 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.666358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.669625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.670704 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.671061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.671396 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] PATH_INFO: `/v3/projects/47007237b6ab4cceace7cffa102cd0b4/users/d1bee8da21c045f49614af8229cc85f3/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.673504 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=47007237b6ab4cceace7cffa102cd0b4, user_id=d1bee8da21c045f49614af8229cc85f3, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.676585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.677662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1352/2663] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:16.683875 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.689730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1312/2664] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:16 2022] PUT /identity/v3/projects/47007237b6ab4cceace7cffa102cd0b4/users/d1bee8da21c045f49614af8229cc85f3/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:16.697048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.698506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38049bdd-89dd-4007-8b0d-0b61f593b1dc admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.698955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.790617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.790873 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc87d8-c0bd-49f4-aa39-160f974297ba admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:16.791627 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.792390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.793239 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] PATH_INFO: `/v3/projects/6ccac0cde5e2433286ed1bd8a501759d/users/49097b839f034e56847deb66da1e7e12/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.799385 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccac0cde5e2433286ed1bd8a501759d, user_id=49097b839f034e56847deb66da1e7e12, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.799574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:16.800774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.801273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.801758 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] PATH_INFO: `/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.803254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3f50d6124b425db6c8e7e5b26625b7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:16.803885 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5e98-7705-410f-bb08-d5789eda2f47 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.805336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:16.818226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1353/2665] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:16 2022] PUT /identity/v3/projects/6ccac0cde5e2433286ed1bd8a501759d/users/49097b839f034e56847deb66da1e7e12/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:16.828989 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.829269 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.829541 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.862854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] MFA Rules not processed for user `49097b839f034e56847deb66da1e7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:16.864466 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.866843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3f50d6124b425db6c8e7e5b26625b7', 'request_id': 'req-f536bcfa-96fe-4a02-973d-235d2a1cef4b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.876199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3f50d6124b425db6c8e7e5b26625b7', 'request_id': 'req-f536bcfa-96fe-4a02-973d-235d2a1cef4b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.889044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3f50d6124b425db6c8e7e5b26625b7', 'request_id': 'req-f536bcfa-96fe-4a02-973d-235d2a1cef4b'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.909442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] The token cache is being invalidate because project 5e3f50d6124b425db6c8e7e5b26625b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:16.910135 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.912257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f536bcfa-96fe-4a02-973d-235d2a1cef4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:16.913991 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1313/2666] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:16 2022] DELETE /identity/v3/projects/5e3f50d6124b425db6c8e7e5b26625b7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:16.920244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc335a-4291-4e69-b87a-55a0418e4304 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:16.920791 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc335a-4291-4e69-b87a-55a0418e4304 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:16.921166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc335a-4291-4e69-b87a-55a0418e4304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:16.940805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1bbc335a-4291-4e69-b87a-55a0418e4304 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:16.941888 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1bbc335a-4291-4e69-b87a-55a0418e4304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:16.952380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1354/2667] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:16.963877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:16.965883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.018390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1314/2668] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:17.026592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.026878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.027211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.034721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0923-3f3d-442e-943e-694daa7e9384 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.038954 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.039815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.040166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.040522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.046696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:17.048006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.053296 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.055372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.058461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1315/2669] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:17.062760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.069965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1355/2670] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:17.074645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b406ba-4558-48c9-a47f-f5aef632318a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.081306 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.081744 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.082076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.082348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.083838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:17.084152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.086138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.103871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1316/2671] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:17.106997 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.119756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b671d-1022-4a20-a06e-e117d94cf479 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.125170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.125839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.126123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.126399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.127096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.129080 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.162333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1356/2672] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:17 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:17.166376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.177240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8f15-dd5f-4a89-a0ad-0383f28b4520 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.252721 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.253417 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.253701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.253985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.254694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.256790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.279198 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1317/2673] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:17 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:17.283512 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.295376 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99762e2-4a99-48c2-87fd-8a47472c5557 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.300549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.301276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.301558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.301873 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.302570 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.306721 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.319343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1357/2674] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:17.323184 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.336697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e0e3-9c2d-4acc-bb8b-f0439169b88a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.348025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.348858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.349211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.349567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.350442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.352455 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e97ef-84de-4fa8-b2f9-893449f6ef11 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.369183 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1318/2675] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:17.370447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.385446 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9911f-7108-4764-b83c-cf3149016e8b admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.392097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.393193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.393357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.393637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] PATH_INFO: `/v3/projects/8aef85b1b50744868c76e1f2e4b9ad84/users/728c6b24c90d4b1499c3cd9a3b368e70/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.421398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aef85b1b50744868c76e1f2e4b9ad84, user_id=728c6b24c90d4b1499c3cd9a3b368e70, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.424153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.447784 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1358/2676] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:17 2022] PUT /identity/v3/projects/8aef85b1b50744868c76e1f2e4b9ad84/users/728c6b24c90d4b1499c3cd9a3b368e70/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:17.456981 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7513-1664-4df5-bf1c-60806da1fd1b None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.457454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7513-1664-4df5-bf1c-60806da1fd1b None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.457920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7513-1664-4df5-bf1c-60806da1fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.492925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ee8b7513-1664-4df5-bf1c-60806da1fd1b None None] MFA Rules not processed for user `728c6b24c90d4b1499c3cd9a3b368e70`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:17.494235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ee8b7513-1664-4df5-bf1c-60806da1fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.584531 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1319/2677] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:17.595559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.597554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.678091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604a52f-4a9b-4a5d-8634-8eabd9b38141 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.685306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.686249 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.686616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.687215 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.713809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.718156 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:17.732221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1359/2678] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:17.738891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb3a5-bafc-4d1d-9ad4-0700c205ea84 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.739391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb3a5-bafc-4d1d-9ad4-0700c205ea84 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.739600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb3a5-bafc-4d1d-9ad4-0700c205ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.776842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1c5bb3a5-bafc-4d1d-9ad4-0700c205ea84 None None] MFA Rules not processed for user `d1bee8da21c045f49614af8229cc85f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:17.778502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1c5bb3a5-bafc-4d1d-9ad4-0700c205ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.810166 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:17.812568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:17.892324 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1320/2679] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:17.916827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a369-c1ee-4f0f-913d-5bb84cc873e3 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:17.925803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:17.926795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:17.927117 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:17.927443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] PATH_INFO: `/v3/users/bc9a68ff18d34031bc026792d7f4ad85` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:17.928950 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9a68ff18d34031bc026792d7f4ad85)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:17.931507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:18.001079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9a68ff18d34031bc026792d7f4ad85'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.011009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9a68ff18d34031bc026792d7f4ad85'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.024534 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9a68ff18d34031bc026792d7f4ad85'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.049976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9a68ff18d34031bc026792d7f4ad85'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.052543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9a68ff18d34031bc026792d7f4ad85'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.068162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1360/2680] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:17 2022] DELETE /identity/v3/users/bc9a68ff18d34031bc026792d7f4ad85 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:18.074569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:18.075321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:18.076083 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:18.109692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:18.111845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:18.221113 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1321/2681] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:18.231960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:18.233509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:18.296142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f00d19-bbe2-4386-a1cd-5b38fc8229ad admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:18.300447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:18.301399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:18.301805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:18.302193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:18.313052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:18.314549 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:18.325995 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1361/2682] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:18.779634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:18.781204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:18.795282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b7fc-27ca-497b-a322-3494676183a1 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:18.801447 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:18.802386 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:18.802633 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:18.803251 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] PATH_INFO: `/v3/projects/5f2af59b512e4495b08666e22e39dd85` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:18.805152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2af59b512e4495b08666e22e39dd85)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:18.807624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:18.874190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2af59b512e4495b08666e22e39dd85', 'request_id': 'req-74af40b8-6060-4589-925e-84be1142fb49'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.881286 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2af59b512e4495b08666e22e39dd85', 'request_id': 'req-74af40b8-6060-4589-925e-84be1142fb49'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.889962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2af59b512e4495b08666e22e39dd85', 'request_id': 'req-74af40b8-6060-4589-925e-84be1142fb49'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.904214 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] The token cache is being invalidate because project 5f2af59b512e4495b08666e22e39dd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:18.904764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.905152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:18.907029 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1322/2683] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:18 2022] DELETE /identity/v3/projects/5f2af59b512e4495b08666e22e39dd85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:18.913948 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:18.925832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c036-8904-4ebb-9d26-1644cdd53037 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:18.993094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:18.994011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:18.994324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:18.994611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] PATH_INFO: `/v3/users/49097b839f034e56847deb66da1e7e12` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:18.995864 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49097b839f034e56847deb66da1e7e12)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:18.997887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.049523 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49097b839f034e56847deb66da1e7e12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.058494 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49097b839f034e56847deb66da1e7e12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.066537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49097b839f034e56847deb66da1e7e12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.080443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49097b839f034e56847deb66da1e7e12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.080678 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49097b839f034e56847deb66da1e7e12'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.087801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1362/2684] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:18 2022] DELETE /identity/v3/users/49097b839f034e56847deb66da1e7e12 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:19.188467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.190845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.214472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af40b8-6060-4589-925e-84be1142fb49 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.291925 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.293045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.293544 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.293720 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] PATH_INFO: `/v3/users/80ecbcd257824804b7528e0b15afb92f` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.295523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ecbcd257824804b7528e0b15afb92f)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.298162 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.369241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ecbcd257824804b7528e0b15afb92f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.370188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ecbcd257824804b7528e0b15afb92f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.379347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ecbcd257824804b7528e0b15afb92f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.395293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ecbcd257824804b7528e0b15afb92f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.406061 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ecbcd257824804b7528e0b15afb92f'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.425870 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1323/2685] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:19 2022] DELETE /identity/v3/users/80ecbcd257824804b7528e0b15afb92f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:19.471745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.473276 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.489207 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74baeb-e666-483f-aace-d30d37028da7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.564039 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.564976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.565301 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.565599 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] PATH_INFO: `/v3/projects/6ccac0cde5e2433286ed1bd8a501759d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.566895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccac0cde5e2433286ed1bd8a501759d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.568913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.620857 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccac0cde5e2433286ed1bd8a501759d', 'request_id': 'req-26c045c6-e17d-4587-99ba-ff377dd904bf'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.631877 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccac0cde5e2433286ed1bd8a501759d', 'request_id': 'req-26c045c6-e17d-4587-99ba-ff377dd904bf'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.643234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccac0cde5e2433286ed1bd8a501759d', 'request_id': 'req-26c045c6-e17d-4587-99ba-ff377dd904bf'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.644211 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.645724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.658545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] The token cache is being invalidate because project 6ccac0cde5e2433286ed1bd8a501759d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:19.659068 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.660469 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26c045c6-e17d-4587-99ba-ff377dd904bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.661213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78336-6ba6-4cbd-903c-61877036072c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.663220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1363/2686] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:19 2022] DELETE /identity/v3/projects/6ccac0cde5e2433286ed1bd8a501759d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:19.668463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f99-4b0c-42e7-96de-da68a7048603 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.669576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f99-4b0c-42e7-96de-da68a7048603 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.669707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992f99-4b0c-42e7-96de-da68a7048603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.688619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-69992f99-4b0c-42e7-96de-da68a7048603 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:19.689800 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-69992f99-4b0c-42e7-96de-da68a7048603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.729600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.731562 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.732348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.732889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] PATH_INFO: `/v3/projects/eccca2ea6e12496dafb40b7980590bfb` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.734375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccca2ea6e12496dafb40b7980590bfb)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.736490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.755953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1364/2687] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:19.765882 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.766263 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.766572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.790036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:19.790397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccca2ea6e12496dafb40b7980590bfb', 'request_id': 'req-2fdca69e-e110-48f0-b370-f272da836b81'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.791887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.797345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccca2ea6e12496dafb40b7980590bfb', 'request_id': 'req-2fdca69e-e110-48f0-b370-f272da836b81'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.806696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccca2ea6e12496dafb40b7980590bfb', 'request_id': 'req-2fdca69e-e110-48f0-b370-f272da836b81'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.830771 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] The token cache is being invalidate because project eccca2ea6e12496dafb40b7980590bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:19.831114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.832006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.833468 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1324/2688] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:19 2022] DELETE /identity/v3/projects/eccca2ea6e12496dafb40b7980590bfb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:19.837594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.839001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:19.870654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1365/2689] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:19.875718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.887343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85a6a-3951-4e2b-afeb-e776280739ad None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.893633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.894609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.895074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.895584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.897590 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:19.898036 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.900307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.909701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdca69e-e110-48f0-b370-f272da836b81 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.913723 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1366/2690] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:19.915578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.916555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.916832 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.917081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] PATH_INFO: `/v3/users/d1bee8da21c045f49614af8229cc85f3` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.918524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bee8da21c045f49614af8229cc85f3)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.919234 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.920654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.931193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da29ae-aa84-406a-b418-eb32f1c5f7eb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:19.936318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:19.937010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:19.937293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:19.937571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:19.938280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:19.940312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:19.975201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1367/2691] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:19 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:19.979891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:19.981381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bee8da21c045f49614af8229cc85f3'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.982138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bee8da21c045f49614af8229cc85f3'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.995438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bee8da21c045f49614af8229cc85f3'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:19.996378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bee8da21c045f49614af8229cc85f3'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.006363 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bee8da21c045f49614af8229cc85f3'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.034654 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1325/2692] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:19 2022] DELETE /identity/v3/users/d1bee8da21c045f49614af8229cc85f3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:20.063694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddda8-91a5-45f1-ab12-50e309391d8c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.135543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.135543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.135543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.135543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.136858 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.137772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.161687 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1368/2693] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:19 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:20.166069 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.167718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.183321 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40b75-68ea-46ac-8f69-e59a00e38b15 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.189833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.190532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.190818 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.191097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.191892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.193595 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.204625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1326/2694] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:20.210085 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.221437 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2141b7-28b5-42bf-af18-bf4c2ea3c1fd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.226863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.227700 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.228031 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.228336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.229226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.230974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.244679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1369/2695] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:20.249176 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.249437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.251485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.260468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36829a-11e9-4b2d-ae8b-61e24e4bc4cd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.268184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.269101 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.269384 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.269660 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] PATH_INFO: `/v3/projects/9fb9d14fd7aa4b37a67bb8ec3ed11412/users/d15a6070bec14c76bafff411ba3c6054/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.274612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b72b-ebc3-4469-bf17-b88247f08e4a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.282571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.283479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.283875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.284045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] PATH_INFO: `/v3/projects/47007237b6ab4cceace7cffa102cd0b4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.285769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47007237b6ab4cceace7cffa102cd0b4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.287362 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb9d14fd7aa4b37a67bb8ec3ed11412, user_id=d15a6070bec14c76bafff411ba3c6054, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.289401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.290111 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7499ca4-3811-4497-8b85-9ce252df6c71 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.306205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1370/2696] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:20 2022] PUT /identity/v3/projects/9fb9d14fd7aa4b37a67bb8ec3ed11412/users/d15a6070bec14c76bafff411ba3c6054/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:20.318005 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.318293 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.318572 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.352555 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] MFA Rules not processed for user `d15a6070bec14c76bafff411ba3c6054`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:20.353760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.375410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47007237b6ab4cceace7cffa102cd0b4', 'request_id': 'req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.385624 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47007237b6ab4cceace7cffa102cd0b4', 'request_id': 'req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.398150 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47007237b6ab4cceace7cffa102cd0b4', 'request_id': 'req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.414443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] The token cache is being invalidate because project 47007237b6ab4cceace7cffa102cd0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:20.414807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.415649 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53267aeb-ea5d-4c44-b986-1d877f0dcc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:20.417558 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1327/2697] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:20 2022] DELETE /identity/v3/projects/47007237b6ab4cceace7cffa102cd0b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:20.422175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f7a80-666f-45b9-8557-fbc6c96074f8 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.422454 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f7a80-666f-45b9-8557-fbc6c96074f8 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.422764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f7a80-666f-45b9-8557-fbc6c96074f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.429638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1371/2698] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:20.434183 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.446825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-f59f7a80-666f-45b9-8557-fbc6c96074f8 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:20.447838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f59f7a80-666f-45b9-8557-fbc6c96074f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.513860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227930b5-2b16-475e-83d6-c7c813e24de5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.519533 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.520525 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.521191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.521571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.522355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.523689 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1328/2699] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:20.524409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.531799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.532119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.532345 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.557994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:20.560426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.561008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1372/2700] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:20.565461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.567454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:20.651242 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29035-71f1-42d5-a69a-d57fd2efa392 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.651359 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1329/2701] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:20.651463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.651463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.651463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.651463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.651826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.653190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.661185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.677126 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee734e2c-81d6-4903-a39e-0735f44ab019 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.684786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.685686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.688303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1373/2702] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:20.690458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.690897 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.692356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:20.692356 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.692952 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.694739 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.705470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b8fa-40cd-4073-b467-aa226518cc21 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.709146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1330/2703] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:20.712916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.713945 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.714127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.714595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.714933 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.715819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.718546 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.724555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79d38d-48d0-4538-b14e-47185db77f77 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.730956 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.731734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.732104 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.732450 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.733255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1374/2704] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:20.733428 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.735152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.737173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.748321 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dbbc-b7c2-4dc0-ae87-f3f6c2997a26 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.753121 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.754043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.754326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.754598 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] PATH_INFO: `/v3/projects/2279077f2370409da353e0b2682f56ae/users/a4c2a2d11cda4018b68e8f674a8b4712/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.772273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2279077f2370409da353e0b2682f56ae, user_id=a4c2a2d11cda4018b68e8f674a8b4712, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.773425 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1331/2705] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:20.774973 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.778237 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.789777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1375/2706] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:20 2022] PUT /identity/v3/projects/2279077f2370409da353e0b2682f56ae/users/a4c2a2d11cda4018b68e8f674a8b4712/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:20.794056 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.857670 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df8b5-9f93-4938-b869-55f2fdc1dd65 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.865815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.866617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.867006 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.867378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.867551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af201a0-eae3-419d-a736-01c4c85b0861 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.868317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.870552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.872884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.873551 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.873821 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.874087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.874820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.876496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.888960 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1376/2707] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:20.893243 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.894776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1332/2708] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:20.900318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.904241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36083-0c22-452a-bb14-c9e9ec07bd0a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.909326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.910245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.910530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.910816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] PATH_INFO: `/v3/projects/2279077f2370409da353e0b2682f56ae/users/a4c2a2d11cda4018b68e8f674a8b4712/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.912894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2279077f2370409da353e0b2682f56ae, user_id=a4c2a2d11cda4018b68e8f674a8b4712, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.913294 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40397964-953a-4441-ab4f-e79e384104f3 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.915571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0ea64-1dcd-46e3-bef1-5ba4aac145da admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.920436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:20.921594 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.922072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.922542 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.923963 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:20.927116 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:20.927417 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1377/2709] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:20 2022] PUT /identity/v3/projects/2279077f2370409da353e0b2682f56ae/users/a4c2a2d11cda4018b68e8f674a8b4712/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:20.938175 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:20.938456 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:20.938728 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:20.942165 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1333/2710] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:20.947017 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:20.962012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f252a6-b225-44b0-bd74-4213581cbf40 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:20.984349 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] MFA Rules not processed for user `a4c2a2d11cda4018b68e8f674a8b4712`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:20.985608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:21.024592 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.025651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.025998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.026896 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.028023 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.030746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.044278 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1334/2711] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:21.049552 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.061822 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7f46-3519-43d7-b8da-cc7aa187b6be admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.062872 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1378/2712] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:21.072131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.073158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.073617 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.073986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] PATH_INFO: `/v3/projects/fce1460a24cc4e5cb0ebf023560d596b/users/c11f7acee6cb4b9e84fe09c350a688a7/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.075014 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.076806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:21.092070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce1460a24cc4e5cb0ebf023560d596b, user_id=c11f7acee6cb4b9e84fe09c350a688a7, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.094777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874d4e8-ca97-4d86-bb4b-cb6c00638932 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.112019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1335/2713] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:21 2022] PUT /identity/v3/projects/fce1460a24cc4e5cb0ebf023560d596b/users/c11f7acee6cb4b9e84fe09c350a688a7/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:21.124130 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.124423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.124663 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.154078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] MFA Rules not processed for user `c11f7acee6cb4b9e84fe09c350a688a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:21.154325 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c7d8-3644-44b5-8572-aab70c16ebbb None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.154998 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:21.213145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.213967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.214353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.214785 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.235155 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1336/2714] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:21.239950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.290432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.291942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.302926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1379/2715] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:21.320762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff88585-c4ad-4924-9e9a-483a0925001a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.332063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.333174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.333668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.334362 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.335365 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.339175 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.378526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1337/2716] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:21 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:21.384196 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.396161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0ef9-5ed4-49c5-b858-544936f35ef8 service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.464051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.465226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.465617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.465979 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.466766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.468958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.501259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1380/2717] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:21 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:21.507696 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.520707 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92984-8a6c-48bf-8bb6-ff3e07c7e0f2 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.531436 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.532234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.532541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.532948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.533730 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.535441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.548584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1338/2718] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:21.555697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.569356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb63a-821d-4ccc-b756-da2a71deaf5e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.577847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.579140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.579435 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.579840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] PATH_INFO: `/v3/projects/3df33744fde2453e80d6d0b9e046fadf/users/403fa7081c8b4ea9b7be5e1aa050e905/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.599912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df33744fde2453e80d6d0b9e046fadf, user_id=403fa7081c8b4ea9b7be5e1aa050e905, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.604764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.625343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1381/2719] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:21 2022] PUT /identity/v3/projects/3df33744fde2453e80d6d0b9e046fadf/users/403fa7081c8b4ea9b7be5e1aa050e905/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:21.634551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.651199 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45260df2-a6b3-4365-a041-d1282c6a0eb5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.731370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.732500 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.732812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.733110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.733910 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.735585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.748246 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1339/2720] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:21.753297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.767906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.768313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851db-5dc0-4e1f-985f-db66190bec4e admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.774507 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.775792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.775958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.776318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] PATH_INFO: `/v3/projects/3df33744fde2453e80d6d0b9e046fadf/users/403fa7081c8b4ea9b7be5e1aa050e905/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.778676 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df33744fde2453e80d6d0b9e046fadf, user_id=403fa7081c8b4ea9b7be5e1aa050e905, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.779568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db4d33-6656-4c3b-a61d-0fc2157ef4f5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:21.781713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e705eb0-e75d-425c-95af-80822b8bc558 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.785112 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:21.786143 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.786489 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.786899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] PATH_INFO: `/v3/users/d15a6070bec14c76bafff411ba3c6054` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.788439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15a6070bec14c76bafff411ba3c6054)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:21.790853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:21.795366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1382/2721] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:21 2022] PUT /identity/v3/projects/3df33744fde2453e80d6d0b9e046fadf/users/403fa7081c8b4ea9b7be5e1aa050e905/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:21.806902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.807172 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.807462 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.850852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] MFA Rules not processed for user `403fa7081c8b4ea9b7be5e1aa050e905`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:21.852670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:21.859630 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15a6070bec14c76bafff411ba3c6054'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:21.860465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15a6070bec14c76bafff411ba3c6054'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:21.872502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15a6070bec14c76bafff411ba3c6054'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:21.873379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15a6070bec14c76bafff411ba3c6054'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:21.887800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-66e30ef3-4dee-419e-a48d-35354eac5417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15a6070bec14c76bafff411ba3c6054'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:21.910934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1340/2722] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:21 2022] DELETE /identity/v3/users/d15a6070bec14c76bafff411ba3c6054 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:21.918114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:21.918566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:21.919303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:21.941829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:21.943486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:21.964148 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1383/2723] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:21.973547 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:21.975832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:22.025502 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1341/2724] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:22.035353 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:22.036905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:22.050231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6a35-1c2d-48ec-b939-a841324eda4a None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:22.109054 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9b4b1-b4b9-4b21-bdd3-60c759a3b893 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:22.109780 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:22.111100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:22.111596 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:22.111990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:22.114010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:22.114717 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:22.115087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:22.115403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:22.125867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:22.127371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:22.138234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1342/2725] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:22.186837 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:22.188278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:22.201259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1384/2726] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:22.296392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:22.306580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9957-4f0d-4faf-87fa-4bb2ac97af31 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:22.311004 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:22.311786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:22.312091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:22.312326 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:22.314351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:22.396621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:22.398115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:22.408316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1343/2727] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:22.482395 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:22.483894 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:22.498265 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386a60b-ae55-41fd-8b9f-c0d658b061fe service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:22.504288 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:22.505414 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:22.505698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:22.506165 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] PATH_INFO: `/v3/projects/9fb9d14fd7aa4b37a67bb8ec3ed11412` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:22.507926 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb9d14fd7aa4b37a67bb8ec3ed11412)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:22.512255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:22.596511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb9d14fd7aa4b37a67bb8ec3ed11412', 'request_id': 'req-5b875bbc-d13d-4a54-8377-b2a3fab1b259'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.604502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb9d14fd7aa4b37a67bb8ec3ed11412', 'request_id': 'req-5b875bbc-d13d-4a54-8377-b2a3fab1b259'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.613138 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb9d14fd7aa4b37a67bb8ec3ed11412', 'request_id': 'req-5b875bbc-d13d-4a54-8377-b2a3fab1b259'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.625315 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] The token cache is being invalidate because project 9fb9d14fd7aa4b37a67bb8ec3ed11412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:22.625606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.626279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.627927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1385/2728] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:22 2022] DELETE /identity/v3/projects/9fb9d14fd7aa4b37a67bb8ec3ed11412 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:22.632423 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:22.644031 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e5bd-361f-486e-b89c-ce879c64386c service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:22.710351 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:22.711158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:22.711438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:22.711743 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] PATH_INFO: `/v3/users/a4c2a2d11cda4018b68e8f674a8b4712` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:22.713028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c2a2d11cda4018b68e8f674a8b4712)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:22.715225 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:22.768039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c2a2d11cda4018b68e8f674a8b4712'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.768700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c2a2d11cda4018b68e8f674a8b4712'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.777131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c2a2d11cda4018b68e8f674a8b4712'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.777983 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c2a2d11cda4018b68e8f674a8b4712'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.787589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-53e29e68-3858-4f40-9e2c-a7add18abaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c2a2d11cda4018b68e8f674a8b4712'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:22.807632 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1344/2729] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:22 2022] DELETE /identity/v3/users/a4c2a2d11cda4018b68e8f674a8b4712 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:23.170426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.173163 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:23.191372 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875bbc-d13d-4a54-8377-b2a3fab1b259 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.263246 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.264314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.264703 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.265127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] PATH_INFO: `/v3/projects/2279077f2370409da353e0b2682f56ae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.266532 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2279077f2370409da353e0b2682f56ae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.268744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.325046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2279077f2370409da353e0b2682f56ae', 'request_id': 'req-e5b15532-3d82-4e58-89f6-96b77c20a1d7'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:23.336550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2279077f2370409da353e0b2682f56ae', 'request_id': 'req-e5b15532-3d82-4e58-89f6-96b77c20a1d7'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:23.349724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2279077f2370409da353e0b2682f56ae', 'request_id': 'req-e5b15532-3d82-4e58-89f6-96b77c20a1d7'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:23.368009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] The token cache is being invalidate because project 2279077f2370409da353e0b2682f56ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:23.368396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:23.369109 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e5b15532-3d82-4e58-89f6-96b77c20a1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:23.371584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1386/2730] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:23 2022] DELETE /identity/v3/projects/2279077f2370409da353e0b2682f56ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:23.378410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.378987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.379100 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.399272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:23.401212 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:23.475275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1345/2731] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:23.483937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.484245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.484468 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.506248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:23.507502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:23.518444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1387/2732] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:23.522589 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.534257 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d416c-583a-4739-80d7-94e7d4d38543 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.539590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.540332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.540610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.540884 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.541635 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:23.541945 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.543647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.556619 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1346/2733] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:23.561059 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.579092 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284b8f-7d62-4bc3-bbde-5c0801481677 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.588126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.589334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.589850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.590272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.591257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.593278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.622898 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1388/2734] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:23 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:23.627391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.642837 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061efb4-3cc5-42c7-8fa0-1db9ff58e96a admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.707491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.708193 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.708473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.708777 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.709439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.711410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.734999 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1347/2735] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:23 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:23.739648 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.751285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0730-7657-47c7-95c5-31b57e02afcf admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.758037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.759023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.759514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.760032 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.761277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.764517 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.780969 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1389/2736] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:23.785960 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.805512 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02295eb2-d09c-439c-80d3-dc1740f1a780 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.812992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.813954 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.814329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.814647 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.815541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.817706 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955ae0f-7501-492a-bb61-24cd05996880 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.830909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1348/2737] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:23.835473 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:23.849986 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55be6-bf6e-43df-a92f-5f98972508a0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:23.856208 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:23.857352 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.857803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.858178 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] PATH_INFO: `/v3/projects/4bfc402349bf4fb6b3730448386ef0e1/users/dfe68bceaaf942d6b7c27f9c61508bec/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.877233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc402349bf4fb6b3730448386ef0e1, user_id=dfe68bceaaf942d6b7c27f9c61508bec, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:23.880010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:23.896522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1390/2738] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:23 2022] PUT /identity/v3/projects/4bfc402349bf4fb6b3730448386ef0e1/users/dfe68bceaaf942d6b7c27f9c61508bec/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:23.911011 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:23.911517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:23.912049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:23.947853 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] MFA Rules not processed for user `dfe68bceaaf942d6b7c27f9c61508bec`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:23.949380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:24.066560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1349/2739] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:24.071658 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.153911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b911-0b1e-42a2-9959-24b7b88a8ba5 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.159316 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.160035 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.160310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.160586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.161299 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.163326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.191332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1391/2740] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:24 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:24.195811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.211453 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638fb4a-503f-4c95-83be-638a913e32ca None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.294088 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.294996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.295487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.295930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.297147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.300487 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.327980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1350/2741] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:24 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:24.333568 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.352701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443c52-bc8a-49a3-979b-af5ab85583b0 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.357852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.358624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.358980 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.359324 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.360228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.361962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.374560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1392/2742] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:24.379561 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.392878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779248fd-c8b5-4283-b4f5-2d40ac06d041 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.399753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.400950 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.401262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.401611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] PATH_INFO: `/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1/users/15163ab60f68444e8526dd3466e9c568/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.430098 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5051d230c3c4ac8906a17f58c9b56f1, user_id=15163ab60f68444e8526dd3466e9c568, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.436548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.463296 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1351/2743] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:24 2022] PUT /identity/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1/users/15163ab60f68444e8526dd3466e9c568/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:24.469623 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.490429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d4ad-c610-48b7-af1c-004c43b61734 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.567139 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.567874 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.568162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.568436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.569182 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.570921 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d984220-8c3b-4266-ba24-172db5513fef admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.582585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1393/2744] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:24.588698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.600163 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5de-35be-45bd-a45d-2d53c8fc412c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.604962 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.605920 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.606202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.606473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] PATH_INFO: `/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1/users/15163ab60f68444e8526dd3466e9c568/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.608857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5051d230c3c4ac8906a17f58c9b56f1, user_id=15163ab60f68444e8526dd3466e9c568, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.611642 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.624787 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1352/2745] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:24 2022] PUT /identity/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1/users/15163ab60f68444e8526dd3466e9c568/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:24.637126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.637611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.638081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.671617 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] MFA Rules not processed for user `15163ab60f68444e8526dd3466e9c568`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:24.674564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:24.760167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1394/2746] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:24.773404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.775293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:24.844895 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a0a8-0b0f-45a4-80f4-d9acd4baeaac admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.848844 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.849526 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.849807 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.850081 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:24.861747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:24.863273 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:24.876065 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1353/2747] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:24.963049 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:24.975631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a66c-05d2-4050-90ec-4db6addf8b16 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:24.980958 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:24.982115 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:24.982482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:24.982830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:25.049237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:25.050730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915e4a0-a24b-42e1-ab2b-a6a081a68333 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:25.061071 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1395/2748] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:25.354124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:25.420169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8114-dc07-4bb4-8819-f8e5c9c277bc service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:25.424887 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:25.425764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:25.426044 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:25.426312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] PATH_INFO: `/v3/users/dfe68bceaaf942d6b7c27f9c61508bec` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:25.427506 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe68bceaaf942d6b7c27f9c61508bec)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:25.429573 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:25.479906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe68bceaaf942d6b7c27f9c61508bec'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:25.480652 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe68bceaaf942d6b7c27f9c61508bec'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:25.496332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe68bceaaf942d6b7c27f9c61508bec'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:25.497068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe68bceaaf942d6b7c27f9c61508bec'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:25.505271 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe68bceaaf942d6b7c27f9c61508bec'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:25.529641 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1354/2749] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:25 2022] DELETE /identity/v3/users/dfe68bceaaf942d6b7c27f9c61508bec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:25.534918 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:25.535489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:25.535489 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:25.560077 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:25.562191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:25.654650 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1396/2750] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:25.666092 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:25.669303 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:25.753312 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec686cc-ebab-403f-9f96-b590ff31554e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:25.763152 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:25.764664 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:25.765513 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:25.766087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:25.783980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:25.786668 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:25.807937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1355/2751] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:26.091135 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:26.094661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:26.112248 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811bc62-2565-4e41-ae48-ff98b1032da7 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:26.117432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:26.118354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:26.118637 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:26.118911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] PATH_INFO: `/v3/projects/4bfc402349bf4fb6b3730448386ef0e1` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:26.120232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfc402349bf4fb6b3730448386ef0e1)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:26.122282 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:26.180922 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfc402349bf4fb6b3730448386ef0e1', 'request_id': 'req-9fc5f291-3213-41c3-bbd3-76d408812785'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.187659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfc402349bf4fb6b3730448386ef0e1', 'request_id': 'req-9fc5f291-3213-41c3-bbd3-76d408812785'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.195999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfc402349bf4fb6b3730448386ef0e1', 'request_id': 'req-9fc5f291-3213-41c3-bbd3-76d408812785'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.206426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] The token cache is being invalidate because project 4bfc402349bf4fb6b3730448386ef0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:26.206711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.207389 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.209134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1397/2752] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:26 2022] DELETE /identity/v3/projects/4bfc402349bf4fb6b3730448386ef0e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:26.213383 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:26.222890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274e2b-83ce-4aef-8b06-10a9e8c8c260 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:26.283495 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:26.284418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:26.284764 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:26.285039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] PATH_INFO: `/v3/users/15163ab60f68444e8526dd3466e9c568` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:26.286333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15163ab60f68444e8526dd3466e9c568)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:26.288369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:26.355656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15163ab60f68444e8526dd3466e9c568'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.356379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15163ab60f68444e8526dd3466e9c568'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.364656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15163ab60f68444e8526dd3466e9c568'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.365511 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15163ab60f68444e8526dd3466e9c568'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.377360 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-f65a6f61-1c93-4f3f-9a31-7054d53e75c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15163ab60f68444e8526dd3466e9c568'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.396204 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1356/2753] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:26 2022] DELETE /identity/v3/users/15163ab60f68444e8526dd3466e9c568 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:26.684346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:26.686863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:26.700890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5f291-3213-41c3-bbd3-76d408812785 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:26.770766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:26.772224 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:26.772369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:26.772631 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] PATH_INFO: `/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:26.773913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5051d230c3c4ac8906a17f58c9b56f1)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:26.775913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:26.841675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5051d230c3c4ac8906a17f58c9b56f1', 'request_id': 'req-b3118af3-cf39-41eb-b512-d0292ee2116f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.846816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5051d230c3c4ac8906a17f58c9b56f1', 'request_id': 'req-b3118af3-cf39-41eb-b512-d0292ee2116f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.856835 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5051d230c3c4ac8906a17f58c9b56f1', 'request_id': 'req-b3118af3-cf39-41eb-b512-d0292ee2116f'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.871408 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] The token cache is being invalidate because project e5051d230c3c4ac8906a17f58c9b56f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:26.871731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.872624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b3118af3-cf39-41eb-b512-d0292ee2116f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:26.874436 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1398/2754] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:26 2022] DELETE /identity/v3/projects/e5051d230c3c4ac8906a17f58c9b56f1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:26.879443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:26.880325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:26.880782 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:26.900124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:26.901371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:26.981032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1357/2755] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:26.990502 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:26.990998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:26.991448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.014422 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:27.016033 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:27.025962 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1399/2756] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:27.031291 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.044192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1e53-22cc-406d-a799-f097d7248cde None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.049703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.050387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.050653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.051264 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.051985 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:27.052452 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.054153 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.070728 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1358/2757] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:27.075884 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.089970 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d65fe-0dbd-4b5a-bd2a-c005bb0d794f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.099653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.101129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.101653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.102212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.103583 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.107129 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.145696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1400/2758] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:27 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:27.150559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.161772 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36fcd-0e4a-4ead-9105-7dfcf24121e7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.271481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.272369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.272651 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.272902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.273598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.275643 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.299333 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1359/2759] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:27 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:27.304528 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.317927 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b720-49e5-49a9-82ea-42e4fb7de6e7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.330122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.331279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.334393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.334783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.335769 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.337920 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.354781 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1401/2760] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:27.359781 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.369927 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d99ad-c3c9-458a-bbcf-ab9dae10825f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.374900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.375569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.375894 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.376284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.377003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.378692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ea16-ee27-4f2e-ad08-8d9b8ee50707 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.389559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1360/2761] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:27.394326 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.405768 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e78a1-eb5d-4a22-b3bc-05c5f922838c admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.410618 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.411545 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.411863 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.412142 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] PATH_INFO: `/v3/projects/d5775ad67ab542f0b4fe1be0b4fff2bc/users/a9f34ddfef8948c8abc6e84ca93317f9/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.428255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5775ad67ab542f0b4fe1be0b4fff2bc, user_id=a9f34ddfef8948c8abc6e84ca93317f9, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.430941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.445258 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1402/2762] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:27 2022] PUT /identity/v3/projects/d5775ad67ab542f0b4fe1be0b4fff2bc/users/a9f34ddfef8948c8abc6e84ca93317f9/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:27.457763 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.458254 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.458748 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.489059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] MFA Rules not processed for user `a9f34ddfef8948c8abc6e84ca93317f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:27.490492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:27.569833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1361/2763] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:27.581899 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.583924 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:27.649416 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c93ad-dd19-4138-a11c-769bd50efcf3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.654210 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.654913 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.655193 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.655470 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.666358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.667887 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491252d-6c51-4f9f-a8bf-99409a566234 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.678379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1403/2764] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:27.706856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:27.806584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595291-eeb6-400b-be3d-51b8d86bc8be None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:27.811915 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:27.812794 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.813099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.813367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] PATH_INFO: `/v3/users/a9f34ddfef8948c8abc6e84ca93317f9` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.814600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f34ddfef8948c8abc6e84ca93317f9)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:27.816599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:27.866421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f34ddfef8948c8abc6e84ca93317f9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:27.867053 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f34ddfef8948c8abc6e84ca93317f9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:27.884527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f34ddfef8948c8abc6e84ca93317f9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:27.885342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f34ddfef8948c8abc6e84ca93317f9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:27.895523 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f34ddfef8948c8abc6e84ca93317f9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:27.927371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1362/2765] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:27 2022] DELETE /identity/v3/users/a9f34ddfef8948c8abc6e84ca93317f9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:27.932284 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:27.932860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:27.932860 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:27.952759 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:27.953996 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:28.016594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1404/2766] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:28.027072 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:28.028847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:28.094757 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cea07-4ace-4531-8d43-924c0ab7110f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:28.099313 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:28.100001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:28.100275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:28.100538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:28.111239 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:28.112769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:28.123479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1363/2767] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:28.476261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:28.478558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:28.501916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ac226-65f5-4f3d-afe0-2d3f8bb9c11e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:28.508403 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:28.509461 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:28.509743 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:28.510067 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] PATH_INFO: `/v3/projects/d5775ad67ab542f0b4fe1be0b4fff2bc` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:28.511624 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5775ad67ab542f0b4fe1be0b4fff2bc)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:28.513761 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:28.576883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5775ad67ab542f0b4fe1be0b4fff2bc', 'request_id': 'req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:28.586367 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5775ad67ab542f0b4fe1be0b4fff2bc', 'request_id': 'req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:28.601396 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5775ad67ab542f0b4fe1be0b4fff2bc', 'request_id': 'req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:28.620382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] The token cache is being invalidate because project d5775ad67ab542f0b4fe1be0b4fff2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:28.620697 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:28.621439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-d16a124b-a77d-4fda-9bb2-aea3e94ec96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:28.623388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1405/2768] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:28 2022] DELETE /identity/v3/projects/d5775ad67ab542f0b4fe1be0b4fff2bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:29.883284 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:29.884845 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:29.898443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0bd3e-5912-4053-9888-5184068b94d7 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:29.972540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:29.973762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:29.974148 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:29.974574 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] PATH_INFO: `/v3/users/c11f7acee6cb4b9e84fe09c350a688a7` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:29.976429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11f7acee6cb4b9e84fe09c350a688a7)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:29.979366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:30.041269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11f7acee6cb4b9e84fe09c350a688a7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.041919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11f7acee6cb4b9e84fe09c350a688a7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.050160 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11f7acee6cb4b9e84fe09c350a688a7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.050928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11f7acee6cb4b9e84fe09c350a688a7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.064811 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11f7acee6cb4b9e84fe09c350a688a7'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.091332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1364/2769] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:29 2022] DELETE /identity/v3/users/c11f7acee6cb4b9e84fe09c350a688a7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:30.097564 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:30.098114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:30.098114 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:30.119635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:30.120965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:30.195447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1406/2770] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:30.206389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:30.208727 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:30.278815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9398-b198-474a-a252-675b6e250293 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:30.283461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:30.284147 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:30.284435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:30.284703 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:30.295016 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:30.296458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:30.306087 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1365/2771] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:30.619291 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:30.621333 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:30.636406 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3523-ecab-44c9-937a-134cee9aaed5 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:30.642447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:30.643345 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:30.643621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:30.643932 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] PATH_INFO: `/v3/projects/fce1460a24cc4e5cb0ebf023560d596b` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:30.645306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce1460a24cc4e5cb0ebf023560d596b)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:30.648356 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:30.704971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce1460a24cc4e5cb0ebf023560d596b', 'request_id': 'req-cae37c0c-635f-4f8e-8b61-be445cdc8f39'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.711548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce1460a24cc4e5cb0ebf023560d596b', 'request_id': 'req-cae37c0c-635f-4f8e-8b61-be445cdc8f39'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.721487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce1460a24cc4e5cb0ebf023560d596b', 'request_id': 'req-cae37c0c-635f-4f8e-8b61-be445cdc8f39'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.736823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] The token cache is being invalidate because project fce1460a24cc4e5cb0ebf023560d596b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:30.737149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.738162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.740756 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1407/2772] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:30 2022] DELETE /identity/v3/projects/fce1460a24cc4e5cb0ebf023560d596b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:30.746607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:30.759747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476b4-8b77-4638-98dc-0e35acc77008 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:30.820424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:30.821213 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:30.821490 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:30.821759 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] PATH_INFO: `/v3/users/403fa7081c8b4ea9b7be5e1aa050e905` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:30.823856 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403fa7081c8b4ea9b7be5e1aa050e905)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:30.825159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:30.892621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403fa7081c8b4ea9b7be5e1aa050e905'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.893401 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403fa7081c8b4ea9b7be5e1aa050e905'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.902377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403fa7081c8b4ea9b7be5e1aa050e905'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.903483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403fa7081c8b4ea9b7be5e1aa050e905'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.916367 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-91719c71-6df9-4ca1-8ac3-0797797f4bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403fa7081c8b4ea9b7be5e1aa050e905'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:30.941812 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1366/2773] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:30 2022] DELETE /identity/v3/users/403fa7081c8b4ea9b7be5e1aa050e905 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:31.009527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.011169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.027589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c0c-635f-4f8e-8b61-be445cdc8f39 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.107692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.108992 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.109358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.109735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] PATH_INFO: `/v3/users/728c6b24c90d4b1499c3cd9a3b368e70` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.112336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728c6b24c90d4b1499c3cd9a3b368e70)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.113378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.167476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728c6b24c90d4b1499c3cd9a3b368e70'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.179841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728c6b24c90d4b1499c3cd9a3b368e70'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.188122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728c6b24c90d4b1499c3cd9a3b368e70'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.200312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728c6b24c90d4b1499c3cd9a3b368e70'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.201057 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728c6b24c90d4b1499c3cd9a3b368e70'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.207270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1408/2774] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:31 2022] DELETE /identity/v3/users/728c6b24c90d4b1499c3cd9a3b368e70 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:31.213203 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.213607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.213906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.232708 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:31.233930 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.266029 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.269355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.314170 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1367/2775] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:31.324336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.326042 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.358369 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef570-3395-4e55-91c5-7960fa0144f1 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.364354 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.365241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.365527 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.365801 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] PATH_INFO: `/v3/projects/3df33744fde2453e80d6d0b9e046fadf` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.367241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df33744fde2453e80d6d0b9e046fadf)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.369198 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.386569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d910-1341-4897-a74c-7048f3a14887 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.390385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.391106 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.391389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.391847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.402922 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.404802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3fa01-9ed0-461c-8878-308833f56022 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.415482 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1368/2776] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:31.417499 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df33744fde2453e80d6d0b9e046fadf', 'request_id': 'req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.424542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df33744fde2453e80d6d0b9e046fadf', 'request_id': 'req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.441122 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df33744fde2453e80d6d0b9e046fadf', 'request_id': 'req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.461144 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] The token cache is being invalidate because project 3df33744fde2453e80d6d0b9e046fadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:31.461672 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.462773 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bd2b6594-d5b9-4a91-b54b-b03f1d2a8b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.465698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1409/2777] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:31 2022] DELETE /identity/v3/projects/3df33744fde2453e80d6d0b9e046fadf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:31.472903 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.473434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.473923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.499008 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:31.500734 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.590341 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1369/2778] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:31.599486 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.599803 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.600096 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.619976 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:31.621247 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.629826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1410/2779] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:31.634608 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.645535 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fdf4b-dddc-4a33-bc58-c459051315dd None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.651825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.652522 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.652800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.653080 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.653824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:31.654131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.655967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.668799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1370/2780] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:31.673411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.684388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63cc0e-9059-4ae7-aa51-e2a035f27891 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.690018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.690702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.690981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.691253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.692021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.693946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.727701 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1411/2781] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:31.733733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.733939 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.738429 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.762738 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c079e-332c-4f8c-8092-705bfea8603f admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.840910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df17d-9f4e-4518-8183-a8ff523564c8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.841527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.843371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.844028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.844640 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] PATH_INFO: `/v3/projects/8aef85b1b50744868c76e1f2e4b9ad84` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.846898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aef85b1b50744868c76e1f2e4b9ad84)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.850554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.850855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.851733 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.852170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.852790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.854277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.858074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.891145 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1412/2782] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:31.896683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:31.909890 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aef85b1b50744868c76e1f2e4b9ad84', 'request_id': 'req-fc1e865c-3bab-47cc-afcc-ca7737fac208'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.910628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014693-c102-439c-a11e-3f79396e6d90 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:31.916987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aef85b1b50744868c76e1f2e4b9ad84', 'request_id': 'req-fc1e865c-3bab-47cc-afcc-ca7737fac208'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.928073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aef85b1b50744868c76e1f2e4b9ad84', 'request_id': 'req-fc1e865c-3bab-47cc-afcc-ca7737fac208'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.945690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] The token cache is being invalidate because project 8aef85b1b50744868c76e1f2e4b9ad84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:31.951825 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.953145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-fc1e865c-3bab-47cc-afcc-ca7737fac208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:31.955952 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1371/2783] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:31 2022] DELETE /identity/v3/projects/8aef85b1b50744868c76e1f2e4b9ad84 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:31.961801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.962315 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.962801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.976055 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:31.976788 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:31.977069 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:31.977544 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:31.978514 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:31.980689 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:31.988215 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:31.989473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:31.999003 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1413/2784] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:31.999287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1372/2785] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:32.000870 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.002694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.016595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604260e5-8147-4d6a-a891-0fb64d7c08e3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.024464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.025364 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.026829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.026829 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.027548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.030045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ccb8-f3ff-4fff-9dc5-7545f3c572e3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.043157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1414/2786] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:32.047843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.058982 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad6ad-12e4-4be0-a4c2-9cede2b19765 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.066091 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.066904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.067357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.067548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.068086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.068299 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.068479 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] PATH_INFO: `/v3/projects/b46d08194d014a1cae4252e30618030c/users/55aa40eec08f4e9785be8e75b48f51a1/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.090410 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46d08194d014a1cae4252e30618030c, user_id=55aa40eec08f4e9785be8e75b48f51a1, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.095096 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9070c-fd1e-446b-a5c2-3f103aa65ecf admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.098889 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:32.100730 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.110987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1415/2787] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:32.114272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1373/2788] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:32 2022] PUT /identity/v3/projects/b46d08194d014a1cae4252e30618030c/users/55aa40eec08f4e9785be8e75b48f51a1/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:32.117273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.125329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.125606 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.125877 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.132168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80f43-51b7-43e7-b80a-38e6cfb0d8e2 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.158424 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] MFA Rules not processed for user `55aa40eec08f4e9785be8e75b48f51a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:32.159834 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.214379 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.215319 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.215603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.215910 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.216681 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:32.216991 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.218644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.231402 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1416/2789] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:32.238228 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.249100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894a683-2061-4206-a6ff-f772390af43a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.254116 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.254818 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.255231 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.255405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.256157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.258151 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.266815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1374/2790] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:32.273259 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.284906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f02c-5b37-4c84-bc78-e83660edfee9 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.290397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.291202 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.291566 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.291871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.292621 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.294871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.298951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1417/2791] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:32.304143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.326718 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1375/2792] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:32.331095 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.395330 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85090e-bd13-44f5-b3b3-76e2a021dc84 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.400594 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.401368 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.401542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.401810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.402560 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.403827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121152-9b29-44a0-a605-e390a95a77bd admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.404584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.409192 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.409740 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.409914 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.410190 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.410905 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.412923 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.426393 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1418/2793] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:32.431827 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.435318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1376/2794] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:32.439733 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.441940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756b00-f572-4b71-a9d5-6f6c15001a94 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.446554 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.447220 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.447503 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.447805 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.448595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.449913 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d60d-84cc-4850-a073-c1853b60bd46 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.450374 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.454760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.455430 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.455745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.456025 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.456776 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.458449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.462428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1419/2795] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:32.466608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.468947 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1377/2796] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:32.473242 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.477640 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842f19b-331a-4d70-90b4-acbb24bd8ae4 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.484336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.485021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.485310 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.485609 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.487620 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.487955 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fb43f-111d-4f79-a6fd-714fedaed199 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.490852 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.493843 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.495379 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.498508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.498508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] PATH_INFO: `/v3/projects/8681ab6f933c4e8b8ffa2169b533120d/users/7b0fa4ececd3403b8fbafdf5219f33ef/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.503719 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1420/2797] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:32.510277 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.517792 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8681ab6f933c4e8b8ffa2169b533120d, user_id=7b0fa4ececd3403b8fbafdf5219f33ef, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.521426 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d589e-acad-4d48-813f-7a2e4bbe0873 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.521751 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.526589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.527524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.527998 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.528278 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] PATH_INFO: `/v3/projects/5e7eb8d9d7ff4e83bfcd7bb6831f27e4/users/c406be4111cb4c8cae0464d09b140a36/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.545097 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1378/2798] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:32 2022] PUT /identity/v3/projects/8681ab6f933c4e8b8ffa2169b533120d/users/7b0fa4ececd3403b8fbafdf5219f33ef/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:32.548849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7eb8d9d7ff4e83bfcd7bb6831f27e4, user_id=c406be4111cb4c8cae0464d09b140a36, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.549661 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.552199 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698085c-5f1a-40cf-a472-3ecb5b624618 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.567397 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1421/2799] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:32 2022] PUT /identity/v3/projects/5e7eb8d9d7ff4e83bfcd7bb6831f27e4/users/c406be4111cb4c8cae0464d09b140a36/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:32.572744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.573090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.573353 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.593103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:32.594334 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.626656 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852e90-0e5e-4251-a481-854847ab7a9b admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.670168 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1422/2800] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:32.681134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.682824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.710354 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.711478 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.711970 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.712419 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.713597 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.717435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.735524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1379/2801] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:32.736855 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.748586 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e88f0-b7d8-4b04-828c-3840a1aadc70 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.753799 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.754697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.755093 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.755370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] PATH_INFO: `/v3/projects/8681ab6f933c4e8b8ffa2169b533120d/users/7b0fa4ececd3403b8fbafdf5219f33ef/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.757590 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8681ab6f933c4e8b8ffa2169b533120d, user_id=7b0fa4ececd3403b8fbafdf5219f33ef, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.760097 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1553-c36b-4d94-82d3-5ab02fcc60d0 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:32.760476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0080d-867e-4568-857c-4a14245900d2 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.766442 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:32.767651 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.768308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.768824 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.772437 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1380/2802] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:32 2022] PUT /identity/v3/projects/8681ab6f933c4e8b8ffa2169b533120d/users/7b0fa4ececd3403b8fbafdf5219f33ef/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:32.784380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:32.785893 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:32.791568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:32.792176 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:32.792667 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:32.797023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1423/2803] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:32.838177 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] MFA Rules not processed for user `7b0fa4ececd3403b8fbafdf5219f33ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:32.839408 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:32.922370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1381/2804] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:32.935622 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:32.937306 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:33.018571 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf13a0-67b9-4c9b-91f7-cb33495fec4e service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:33.091113 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:33.091830 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:33.092112 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:33.092383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:33.105190 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:33.106881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d76da-5f77-49a4-9b69-2c0a22d5ffe2 service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:33.118823 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1424/2805] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:33.242994 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:33.263368 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06cf37-8286-4bc2-91e3-fb762855d113 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:33.270694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:33.272269 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:33.272838 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:33.273316 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:33.366967 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:33.369902 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:33.385802 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1382/2806] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:33.659082 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690382-6c8e-4f94-b55e-fb4950d627d0 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:33.659683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690382-6c8e-4f94-b55e-fb4950d627d0 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:33.660087 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690382-6c8e-4f94-b55e-fb4950d627d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:33.693008 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-fe690382-6c8e-4f94-b55e-fb4950d627d0 None None] MFA Rules not processed for user `c406be4111cb4c8cae0464d09b140a36`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:33.694153 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-fe690382-6c8e-4f94-b55e-fb4950d627d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:33.780203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1425/2807] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:33.797207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:33.806158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061e177-a40e-49bd-8d13-8aae78130dce service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:33.810159 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:33.810875 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:33.811217 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:33.811548 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:33.820833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:33.822442 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:33.832883 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1383/2808] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:35.244471 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:35.245294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:35.245294 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:35.265043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] MFA Rules not processed for user `c406be4111cb4c8cae0464d09b140a36`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:35.266332 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:35.274098 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1426/2809] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:35.321388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:35.323232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:35.409555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3549d1-2eef-4416-9e32-3e54ba176683 service cinder] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:35.414298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:35.415041 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:35.415325 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:35.415598 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:35.418063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:35.506433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:35.508001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:35.520694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1384/2810] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:36.202772 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:36.285677 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42698-d1a7-4bc3-b24a-b923a253f9c6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:36.291237 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:36.292159 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:36.292441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:36.292825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] PATH_INFO: `/v3/users/55aa40eec08f4e9785be8e75b48f51a1` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:36.294339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=55aa40eec08f4e9785be8e75b48f51a1)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:36.296314 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:36.356157 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55aa40eec08f4e9785be8e75b48f51a1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:36.365691 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55aa40eec08f4e9785be8e75b48f51a1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:36.375504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55aa40eec08f4e9785be8e75b48f51a1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:36.381992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:36.383935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:36.388381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55aa40eec08f4e9785be8e75b48f51a1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:36.389169 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-4694b4ef-c6e1-427e-b547-a715a4eb9abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55aa40eec08f4e9785be8e75b48f51a1'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:36.396478 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1427/2811] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:36 2022] DELETE /identity/v3/users/55aa40eec08f4e9785be8e75b48f51a1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:36.400747 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:36.401373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:36.401586 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:36.421625 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:36.422977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:36.449494 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a45b-8a01-4410-bc48-6e0834e9bd42 service glance] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:36.491048 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1428/2812] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:36.500563 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:36.502911 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:36.503133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:36.504024 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:36.504300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:36.504567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:36.506287 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:36.516192 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2313ae6-333a-4669-bb6c-9f85d3b3ea72 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:36.520633 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:36.521959 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:36.522251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:36.522531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:36.533432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:36.535043 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:36.547274 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1429/2813] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 15:00:36.596726 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:36.598865 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:36.612817 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1385/2814] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:36.882984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:36.885149 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:36.908201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029d3e-2bcf-472a-a9dc-0a6c926566bb service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:36.919078 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:36.920021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:36.920302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:36.920573 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] PATH_INFO: `/v3/projects/b46d08194d014a1cae4252e30618030c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:36.921854 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46d08194d014a1cae4252e30618030c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:36.923965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:36.995735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46d08194d014a1cae4252e30618030c', 'request_id': 'req-20765ff4-c0b7-42ee-8e82-6498e882c12a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.004614 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46d08194d014a1cae4252e30618030c', 'request_id': 'req-20765ff4-c0b7-42ee-8e82-6498e882c12a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.014428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46d08194d014a1cae4252e30618030c', 'request_id': 'req-20765ff4-c0b7-42ee-8e82-6498e882c12a'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.027251 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] The token cache is being invalidate because project b46d08194d014a1cae4252e30618030c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:37.027565 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.028302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.030154 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1430/2815] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:36 2022] DELETE /identity/v3/projects/b46d08194d014a1cae4252e30618030c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:37.036027 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:37.047102 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdbfad-674f-4a83-9ef0-b9a97e687c34 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:37.109580 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:37.110371 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:37.110646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:37.110921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] PATH_INFO: `/v3/users/7b0fa4ececd3403b8fbafdf5219f33ef` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:37.112272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0fa4ececd3403b8fbafdf5219f33ef)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:37.114220 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:37.167178 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0fa4ececd3403b8fbafdf5219f33ef'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.168076 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0fa4ececd3403b8fbafdf5219f33ef'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.176317 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0fa4ececd3403b8fbafdf5219f33ef'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.177114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0fa4ececd3403b8fbafdf5219f33ef'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.185653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-76f99b75-6053-4156-b00f-870e8b4cc495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0fa4ececd3403b8fbafdf5219f33ef'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.206686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1386/2816] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:37 2022] DELETE /identity/v3/users/7b0fa4ececd3403b8fbafdf5219f33ef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:37.584888 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:37.592699 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:37.610621 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765ff4-c0b7-42ee-8e82-6498e882c12a admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:37.681561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:37.682444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:37.682738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:37.683009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] PATH_INFO: `/v3/projects/8681ab6f933c4e8b8ffa2169b533120d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:37.684448 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8681ab6f933c4e8b8ffa2169b533120d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:37.686381 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:37.744909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8681ab6f933c4e8b8ffa2169b533120d', 'request_id': 'req-03d6e603-9f41-483c-8166-1d148ce9e456'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.752966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8681ab6f933c4e8b8ffa2169b533120d', 'request_id': 'req-03d6e603-9f41-483c-8166-1d148ce9e456'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.764351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8681ab6f933c4e8b8ffa2169b533120d', 'request_id': 'req-03d6e603-9f41-483c-8166-1d148ce9e456'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.779020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] The token cache is being invalidate because project 8681ab6f933c4e8b8ffa2169b533120d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:37.779279 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.779977 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-03d6e603-9f41-483c-8166-1d148ce9e456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:37.781825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1431/2817] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:37 2022] DELETE /identity/v3/projects/8681ab6f933c4e8b8ffa2169b533120d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:37.786823 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:37.787492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:37.787492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:37.814405 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:37.816538 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:37.905934 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1387/2818] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:37.914386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:37.914685 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:37.914971 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:37.935280 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:37.936605 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:37.947399 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1432/2819] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:37.952644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:37.964710 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c0f2-d71f-47f2-942f-125e9ea3a4df None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:37.971051 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:37.972099 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:37.972461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:37.972795 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] PATH_INFO: `/v3/domains` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:37.974576 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:37.975144 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:37.977790 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:37.994169 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1388/2820] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:37.999750 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.012670 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452757-1d45-457c-b9b9-996bbfcaf3f6 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.018501 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.020106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.020509 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.020796 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.021982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.025985 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.065134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1433/2821] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:37 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:38.070110 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.082426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78948f-1439-4aa9-9255-56ff55a57769 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.156995 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.157569 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.157878 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.158120 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.158827 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.160880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.186666 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1389/2822] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:38 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 15:00:38.192506 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.203543 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d639-6c8f-4d78-ac08-425dfef04052 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.208745 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.209457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.209722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.209990 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.210748 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.212491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.224718 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1434/2823] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:38.228784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.245376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f1bf-da1a-4352-baf5-d0a985e4e271 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.250861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.251563 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.251876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.252145 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.252889 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.254545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e7820-d273-4148-9d90-51e9e20caec8 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.266381 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1390/2824] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 15:00:38.270661 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.281953 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c781f5-e894-4576-8074-43602aa14304 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.286916 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.287937 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.288214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.288488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] PATH_INFO: `/v3/projects/9be1e8783d73414ab659999fd731385d/users/0c56b1fbad2240e4a8edc0c8bbd0e64c/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.306574 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be1e8783d73414ab659999fd731385d, user_id=0c56b1fbad2240e4a8edc0c8bbd0e64c, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.309423 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.334675 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1435/2825] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:38 2022] PUT /identity/v3/projects/9be1e8783d73414ab659999fd731385d/users/0c56b1fbad2240e4a8edc0c8bbd0e64c/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:38.342435 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.343138 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.343698 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.377520 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] MFA Rules not processed for user `0c56b1fbad2240e4a8edc0c8bbd0e64c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:38.378813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:38.451657 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1391/2826] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:38.459942 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.529561 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fb343-68a7-4654-833c-23cdf4fe7260 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.535724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.537233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.537233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.537233 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.537843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.539966 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.579483 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1436/2827] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:38 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:38.580941 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.602747 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab9fc-fe7c-4f12-b8cd-74d7c6173141 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.684835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de226-be88-4776-9673-57eba0295387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.685532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de226-be88-4776-9673-57eba0295387 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.685806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de226-be88-4776-9673-57eba0295387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.686071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de226-be88-4776-9673-57eba0295387 admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.687022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564de226-be88-4776-9673-57eba0295387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.689565 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564de226-be88-4776-9673-57eba0295387 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.718899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1392/2828] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:38 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:38.720260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.735815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7e6c-7390-431b-8cdb-747126be1eb6 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.741018 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.741712 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.742357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.742357 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.743044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.744987 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.758339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1437/2829] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:38.762857 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de226-be88-4776-9673-57eba0295387 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.773690 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de226-be88-4776-9673-57eba0295387 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.789319 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.790885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.791491 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.792022 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] PATH_INFO: `/v3/projects/60a019e401fd42e499e6fb7cdf44af2d/users/78470e0d588a474084cd7d511ef54248/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.827800 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a019e401fd42e499e6fb7cdf44af2d, user_id=78470e0d588a474084cd7d511ef54248, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.836885 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.854847 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1393/2830] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:38 2022] PUT /identity/v3/projects/60a019e401fd42e499e6fb7cdf44af2d/users/78470e0d588a474084cd7d511ef54248/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:38.860363 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:38.871763 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b0c-a362-443f-ac6d-90e49db34285 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:38.966550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:38.967268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:38.967595 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:38.968558 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:38.969449 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:38.971086 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a997-efa8-4ae7-853e-016fe5b14a88 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:38.984522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1438/2831] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:38.991806 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:39.010348 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5728-24d8-43e9-821c-adcd2e271cde admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:39.019101 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:39.021458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.021987 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.022645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] PATH_INFO: `/v3/projects/60a019e401fd42e499e6fb7cdf44af2d/users/78470e0d588a474084cd7d511ef54248/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.026476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a019e401fd42e499e6fb7cdf44af2d, user_id=78470e0d588a474084cd7d511ef54248, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:39.032928 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:39.060057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1394/2832] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:38 2022] PUT /identity/v3/projects/60a019e401fd42e499e6fb7cdf44af2d/users/78470e0d588a474084cd7d511ef54248/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:39.078045 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.078311 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.078606 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.109128 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] MFA Rules not processed for user `78470e0d588a474084cd7d511ef54248`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:39.110404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:39.199539 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1439/2833] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:39.211578 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:39.213438 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:39.280551 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607cf9-9ae4-4f54-b73b-245c1fa56004 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:39.284547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:39.285539 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.286527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.286527 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.297874 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:39.300298 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bb53c-c2a7-49e2-b48c-5090459f68c6 service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:39.311603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1395/2834] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:39.346908 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:39.422386 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71287040-8606-47d1-bfdd-36f07525efd4 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:39.427262 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:39.428184 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.428457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.428724 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] PATH_INFO: `/v3/users/0c56b1fbad2240e4a8edc0c8bbd0e64c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.429967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c56b1fbad2240e4a8edc0c8bbd0e64c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:39.431955 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:39.487351 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c56b1fbad2240e4a8edc0c8bbd0e64c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:39.498688 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c56b1fbad2240e4a8edc0c8bbd0e64c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:39.509522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c56b1fbad2240e4a8edc0c8bbd0e64c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:39.522160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c56b1fbad2240e4a8edc0c8bbd0e64c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:39.522929 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c56b1fbad2240e4a8edc0c8bbd0e64c'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:39.529550 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1440/2835] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:39 2022] DELETE /identity/v3/users/0c56b1fbad2240e4a8edc0c8bbd0e64c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:39.534749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.535567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.535567 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.558645 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:39.559900 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:39.621545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1396/2836] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:39.634030 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:39.636272 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:39.728820 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9189-5594-4ce4-a259-a0be06a42ed3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:39.733521 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:39.734191 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:39.734464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:39.734731 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:39.745388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:39.746999 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:39.757682 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1441/2837] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:40.067921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:40.069912 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:40.084496 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb624-00f3-423a-ac60-a6b8bfdb9d5d None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:40.090835 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:40.091906 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:40.092188 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:40.092465 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] PATH_INFO: `/v3/projects/9be1e8783d73414ab659999fd731385d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:40.093876 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be1e8783d73414ab659999fd731385d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:40.095921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:40.151441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be1e8783d73414ab659999fd731385d', 'request_id': 'req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.159108 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be1e8783d73414ab659999fd731385d', 'request_id': 'req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.170146 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be1e8783d73414ab659999fd731385d', 'request_id': 'req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.186050 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] The token cache is being invalidate because project 9be1e8783d73414ab659999fd731385d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:40.186329 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.186980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.188581 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1397/2838] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:40 2022] DELETE /identity/v3/projects/9be1e8783d73414ab659999fd731385d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:40.193016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:40.204463 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ec0e-8041-429f-858b-77852e57520a service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:40.272826 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:40.273256 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:40.273535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:40.273883 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] PATH_INFO: `/v3/users/78470e0d588a474084cd7d511ef54248` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:40.275079 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78470e0d588a474084cd7d511ef54248)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:40.279221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:40.333919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78470e0d588a474084cd7d511ef54248'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.342849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78470e0d588a474084cd7d511ef54248'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.353273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78470e0d588a474084cd7d511ef54248'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.366102 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78470e0d588a474084cd7d511ef54248'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.366944 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-bcac9c7e-74b5-4018-b5eb-4b37146685c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78470e0d588a474084cd7d511ef54248'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.373454 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1442/2839] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:40 2022] DELETE /identity/v3/users/78470e0d588a474084cd7d511ef54248 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:40.665736 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:40.666996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:40.681234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff21f-0d9a-47b9-8e68-38e7e2e7ae07 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:40.746993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:40.747861 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:40.748194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:40.748467 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] PATH_INFO: `/v3/projects/60a019e401fd42e499e6fb7cdf44af2d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:40.749813 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a019e401fd42e499e6fb7cdf44af2d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:40.751786 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:40.801288 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a019e401fd42e499e6fb7cdf44af2d', 'request_id': 'req-4f938248-9403-40fd-8db1-a0118c7307c9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.808389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a019e401fd42e499e6fb7cdf44af2d', 'request_id': 'req-4f938248-9403-40fd-8db1-a0118c7307c9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.818517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a019e401fd42e499e6fb7cdf44af2d', 'request_id': 'req-4f938248-9403-40fd-8db1-a0118c7307c9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.830244 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] The token cache is being invalidate because project 60a019e401fd42e499e6fb7cdf44af2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:40.830557 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.831228 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-4f938248-9403-40fd-8db1-a0118c7307c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:40.832867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1398/2840] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:40 2022] DELETE /identity/v3/projects/60a019e401fd42e499e6fb7cdf44af2d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:40.837832 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:40.838343 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:40.838518 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:40.862464 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:40.866010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:40.934783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1443/2841] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:00:40.943322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:40.943583 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:40.943880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:40.974390 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:40.976046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:40.987483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1399/2842] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:40.991915 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.002388 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b0f8-ec38-4d77-948f-87e7d400fa69 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.007792 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.008479 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.008764 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.009044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.009787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:41.010091 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.011758 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.031644 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1444/2843] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 15:00:41.036937 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.047815 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba43e4-6eb9-40e4-9a21-4ae873fb23c4 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.053545 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.054243 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.054525 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.054801 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.055508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.057532 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.091824 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1400/2844] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:41 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:41.097201 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.107931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4535b-8391-4304-bcdc-f846e3eec327 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.176611 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.177839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.178297 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.178810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.180090 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.184103 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.213510 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1445/2845] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:41 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:41.218364 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.230255 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2dd3c-21f2-4727-942b-fcbf5d20cef5 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.236196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.236892 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.237173 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.237449 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.238207 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.240049 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.253366 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1401/2846] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:41.257923 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.268993 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7d0d-8904-4de6-ba42-8d86bcc43309 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.274589 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.275312 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.275600 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.275914 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.276671 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.278491 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2521-1488-4231-b7f3-53f3adc6758e admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.295787 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1446/2847] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:41.296867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.311709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdcb4b-a155-47dc-80f1-003559569136 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.319476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.321907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.321907 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.322327 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] PATH_INFO: `/v3/projects/63753c02c3f945599ec5e9f42e455507/users/571f9ee4517e4c4d931548ab007b9687/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.346946 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63753c02c3f945599ec5e9f42e455507, user_id=571f9ee4517e4c4d931548ab007b9687, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.351389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.371901 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1402/2848] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:41 2022] PUT /identity/v3/projects/63753c02c3f945599ec5e9f42e455507/users/571f9ee4517e4c4d931548ab007b9687/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:41.383127 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.383492 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.383815 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.415895 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] MFA Rules not processed for user `571f9ee4517e4c4d931548ab007b9687`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:41.417164 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:41.502022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1447/2849] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:41.505201 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.588388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf795480-fdd3-4a19-afb9-24a9562f2091 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.594830 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.595655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.595655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.595655 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.596769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.599070 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.630553 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1403/2850] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:41 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:41.634744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.656213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c0bfd-0242-48c7-81c3-11353c0d2151 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.720213 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.720931 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.721273 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.721610 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.722405 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.724576 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.746819 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1448/2851] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:41 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:41.752754 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.764372 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820942-4e2c-4f2c-9bb0-953fb8b1dcf7 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.769391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.770073 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.770347 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.770612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.773032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.773370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.786724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1404/2852] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:41.792975 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.806162 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4b9e-0b71-4d23-9df6-2ab271f0b4c8 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.812218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.813286 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.813619 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.813941 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] PATH_INFO: `/v3/projects/065661f29da04c7795bae0f563377c58/users/6743393376fb47a293de5b4c2fd1b793/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.833052 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065661f29da04c7795bae0f563377c58, user_id=6743393376fb47a293de5b4c2fd1b793, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.835850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.854037 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1449/2853] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:41 2022] PUT /identity/v3/projects/065661f29da04c7795bae0f563377c58/users/6743393376fb47a293de5b4c2fd1b793/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:41.859123 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.877276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc333-7d13-49ac-b9ea-dd47eb1f367e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.948293 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.948978 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.949279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.949554 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.950295 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.952019 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc87fc-b0e5-48ba-a316-894751cf2db0 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:41.963105 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1405/2854] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:41.967645 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:41.981498 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474c62-519c-4507-a272-f8c9c25b8417 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:41.987912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:41.989021 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:41.989382 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:41.989713 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] PATH_INFO: `/v3/projects/065661f29da04c7795bae0f563377c58/users/6743393376fb47a293de5b4c2fd1b793/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:41.992425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=065661f29da04c7795bae0f563377c58, user_id=6743393376fb47a293de5b4c2fd1b793, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:41.995205 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:42.012047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1450/2855] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:41 2022] PUT /identity/v3/projects/065661f29da04c7795bae0f563377c58/users/6743393376fb47a293de5b4c2fd1b793/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:42.034034 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:42.034400 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:42.034820 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:42.085059 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] MFA Rules not processed for user `6743393376fb47a293de5b4c2fd1b793`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:42.087194 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:42.164481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1406/2856] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:42.176028 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:42.177925 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:42.265346 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8708ac-d9f5-4e0c-b58d-110618e815fb admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:42.269834 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:42.270530 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:42.270809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:42.271430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:42.282902 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:42.284480 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:42.295839 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1451/2857] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:42.418591 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:42.428879 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dafcf-9f5b-4166-b8dc-fb0175f54c64 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:42.433185 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb06fb2f9574061859dc8e25ec44bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:42.433997 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:42.434274 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:42.434543 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:42.495911 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:42.497404 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f730966-7970-4f66-8967-8bcd0e59f30f service cinder] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:42.507849 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1407/2858] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:45.331896 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:45.399420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ef47-01f9-4819-acea-78af3b15699c service cinder] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:45.405245 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:45.406308 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:45.406657 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:45.408194 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] PATH_INFO: `/v3/users/571f9ee4517e4c4d931548ab007b9687` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:45.409635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571f9ee4517e4c4d931548ab007b9687)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:45.411608 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:45.472307 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571f9ee4517e4c4d931548ab007b9687'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:45.481722 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571f9ee4517e4c4d931548ab007b9687'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:45.489766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571f9ee4517e4c4d931548ab007b9687'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:45.505241 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571f9ee4517e4c4d931548ab007b9687'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:45.506106 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571f9ee4517e4c4d931548ab007b9687'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:45.513226 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1452/2859] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:45 2022] DELETE /identity/v3/users/571f9ee4517e4c4d931548ab007b9687 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:45.519272 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:45.519805 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:45.519909 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:45.538695 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:45.540021 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:45.606944 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1408/2860] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:45.618974 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:45.625488 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:45.682754 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fe6c0-9f2a-4895-94dc-ae0c04d0bc00 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:45.687143 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:45.687846 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:45.688134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:45.688409 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:45.702110 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:45.703613 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:45.714809 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1453/2861] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:46.003483 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:46.005343 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:46.018762 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4a36-7a7e-4410-aa99-9cb688b883ca None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:46.024601 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:46.025613 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.025780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.026068 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] PATH_INFO: `/v3/projects/63753c02c3f945599ec5e9f42e455507` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.027403 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63753c02c3f945599ec5e9f42e455507)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:46.029458 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:46.082471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63753c02c3f945599ec5e9f42e455507', 'request_id': 'req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.093234 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63753c02c3f945599ec5e9f42e455507', 'request_id': 'req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.104686 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63753c02c3f945599ec5e9f42e455507', 'request_id': 'req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.122380 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] The token cache is being invalidate because project 63753c02c3f945599ec5e9f42e455507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:46.122753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.123785 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.126462 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1409/2862] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:46 2022] DELETE /identity/v3/projects/63753c02c3f945599ec5e9f42e455507 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:46.131212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:46.144776 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fce4-71e3-432d-a8f6-f963083d48db service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:46.207638 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:46.209160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.209655 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.210134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] PATH_INFO: `/v3/users/6743393376fb47a293de5b4c2fd1b793` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.212214 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6743393376fb47a293de5b4c2fd1b793)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:46.216042 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:46.283951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6743393376fb47a293de5b4c2fd1b793'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.293366 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6743393376fb47a293de5b4c2fd1b793'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.303404 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6743393376fb47a293de5b4c2fd1b793'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.318696 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6743393376fb47a293de5b4c2fd1b793'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.319440 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-26786ef7-e429-405e-bf16-747e3a5c167c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6743393376fb47a293de5b4c2fd1b793'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.326081 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1454/2863] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:00:46 2022] DELETE /identity/v3/users/6743393376fb47a293de5b4c2fd1b793 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:46.618388 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:46.619935 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:46.632891 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faf72-4ab6-4e0b-92f9-c4dd65fb2ac1 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:46.698829 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:46.699826 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.700156 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.700397 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] PATH_INFO: `/v3/projects/065661f29da04c7795bae0f563377c58` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.701612 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065661f29da04c7795bae0f563377c58)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:46.703575 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:46.761232 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065661f29da04c7795bae0f563377c58', 'request_id': 'req-9c019639-5085-4d88-afac-3bec7f7a54b9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.769904 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065661f29da04c7795bae0f563377c58', 'request_id': 'req-9c019639-5085-4d88-afac-3bec7f7a54b9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.785673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065661f29da04c7795bae0f563377c58', 'request_id': 'req-9c019639-5085-4d88-afac-3bec7f7a54b9'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.800256 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] The token cache is being invalidate because project 065661f29da04c7795bae0f563377c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:00:46.800572 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.801332 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-9c019639-5085-4d88-afac-3bec7f7a54b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:00:46.803127 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1410/2864] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:00:46 2022] DELETE /identity/v3/projects/065661f29da04c7795bae0f563377c58 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:46.810260 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.810831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.810831 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.832428 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:46.833679 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:46.897760 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1455/2865] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:46.906541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.906850 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.907124 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.930322 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:46.931701 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:46.942318 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1411/2866] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:46.946890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:46.958020 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d11f84-3826-4ed9-bd73-43081d01582e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:46.963378 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:46.964100 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:46.964476 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:46.964762 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] PATH_INFO: `/v3/domains` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:46.965504 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86303) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 15:00:46.965816 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:46.967430 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:46.981244 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1456/2867] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 15:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 15:00:46.986537 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:46.996508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143351a8-e90d-4c76-9d7c-8320cc5d7a4a None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.001486 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.002157 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.002434 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.002709 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.003409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.005387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.035078 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1412/2868] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:46 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:47.039753 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:47.054707 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163da836-62fb-43c6-bedd-67f991670828 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.122766 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.123451 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.123843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.124123 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.124843 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.126777 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.148212 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1457/2869] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:47 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:47.152568 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:47.166241 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19b47-12f5-4dc0-a987-bf0fe55314ab admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.172653 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.173320 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.173599 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.173871 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.174604 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.176275 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.188003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1413/2870] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:47.192904 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:47.203951 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d7cba-8ced-4194-92fa-e527241db5f7 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.209450 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.210137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.210420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.210694 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.211421 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.213095 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0150-b7cc-414a-a252-70a79fb87eff admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.223075 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1458/2871] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:47.227611 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:47.238378 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bd611-a269-4671-a013-5f215ce93a24 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.244737 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.245745 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.246003 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.246283 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] PATH_INFO: `/v3/projects/0ddd059d96794328b377382ffa0bb824/users/363be0596af84866bc099452ba5aabd4/roles/81b7812443324595b557a25ca9559d8d` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.264833 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddd059d96794328b377382ffa0bb824, user_id=363be0596af84866bc099452ba5aabd4, role_id=81b7812443324595b557a25ca9559d8d)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.267540 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.285517 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1414/2872] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:47 2022] PUT /identity/v3/projects/0ddd059d96794328b377382ffa0bb824/users/363be0596af84866bc099452ba5aabd4/roles/81b7812443324595b557a25ca9559d8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:47.290828 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c660b-3891-431c-af51-817a2e571971 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.291126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c660b-3891-431c-af51-817a2e571971 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.291398 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c660b-3891-431c-af51-817a2e571971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.309981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ce5c660b-3891-431c-af51-817a2e571971 None None] MFA Rules not processed for user `e2fff94fab47494ebebc775758ec7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:47.311635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ce5c660b-3891-431c-af51-817a2e571971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:47.383810 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1459/2873] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:47.393671 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:47.395559 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:47.453266 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7e42-4d07-4b12-bd01-70d4ffb74493 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:47.456919 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:47.457570 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:47.457848 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:47.458119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:47.467584 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:47.469064 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246fee2-d9f3-4f9f-8c08-1a3159c6b131 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:47.479330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1415/2874] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:51.735790 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:51.736673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:51.737118 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:51.759432 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] MFA Rules not processed for user `c406be4111cb4c8cae0464d09b140a36`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:51.763253 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:51.864797 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1460/2875] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:52.045063 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.045471 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.045555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.116634 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] MFA Rules not processed for user `363be0596af84866bc099452ba5aabd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:52.118046 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:52.204196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1416/2876] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:52.208654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.220585 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dbf08-dc4b-4f21-9be4-69cc61dc0a72 None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.226017 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.226698 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.226981 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.227257 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.228046 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.230010 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.263089 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1461/2877] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 15:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:52.267547 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.282463 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa7dc-6706-4c5f-a8f2-869605135427 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.353917 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.354607 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.354921 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.355196 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] PATH_INFO: `/v3/users` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.355936 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.357931 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.381441 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1417/2878] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 15:00:52 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 15:00:52.385673 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.397339 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355bc6-c05e-478d-af3c-7e96171a2ae3 admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.402520 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.403373 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.403653 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.403984 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.404720 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.406358 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.417795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1462/2879] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:52.421961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.437880 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58e93-87c6-4589-9635-c3186cf670ca admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.445493 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.447377 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.447694 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.447996 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] PATH_INFO: `/v3/projects/083851306ec341048c5bae3d3fb70d7c/users/7cb0a943e74f4d79ad1b4d2d51032270/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.464673 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=083851306ec341048c5bae3d3fb70d7c, user_id=7cb0a943e74f4d79ad1b4d2d51032270, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.467461 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.484625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1418/2880] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:52 2022] PUT /identity/v3/projects/083851306ec341048c5bae3d3fb70d7c/users/7cb0a943e74f4d79ad1b4d2d51032270/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 15:00:52.488840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.501727 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca27e04-5d51-43c3-be8a-381c758ec6ff admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.599264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.600179 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.600535 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.600967 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.601692 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.603380 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63b943-2b91-4dfa-8edf-c6d5dc1c18a6 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.614702 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1463/2881] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 15:00:52.618669 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:52.635899 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259959f6-4af1-479d-bb91-60fb9f3f29fa admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:52.646541 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:52.647445 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:52.647893 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:52.648174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] PATH_INFO: `/v3/projects/083851306ec341048c5bae3d3fb70d7c/users/7cb0a943e74f4d79ad1b4d2d51032270/roles/cb8cb673d5d74b15a4528bf0f52ecaae` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:52.650265 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=083851306ec341048c5bae3d3fb70d7c, user_id=7cb0a943e74f4d79ad1b4d2d51032270, role_id=cb8cb673d5d74b15a4528bf0f52ecaae)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:52.653094 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:52.665714 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1419/2882] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 15:00:52 2022] PUT /identity/v3/projects/083851306ec341048c5bae3d3fb70d7c/users/7cb0a943e74f4d79ad1b4d2d51032270/roles/cb8cb673d5d74b15a4528bf0f52ecaae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:00:57.966738 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dedfa-b4a5-4848-9e8e-bf4f0d6dacc2 None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:57.967542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dedfa-b4a5-4848-9e8e-bf4f0d6dacc2 None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:57.967542 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dedfa-b4a5-4848-9e8e-bf4f0d6dacc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:57.995840 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-261dedfa-b4a5-4848-9e8e-bf4f0d6dacc2 None None] MFA Rules not processed for user `7cb0a943e74f4d79ad1b4d2d51032270`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:57.997355 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-261dedfa-b4a5-4848-9e8e-bf4f0d6dacc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:58.072418 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1464/2883] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:58.080235 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:58.082131 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:58.143485 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87903-756f-48b5-9778-6524d1f48b6c admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:58.147841 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3408c447488e472399394fdd26215a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:58.148499 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:58.148775 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:58.149045 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:58.217712 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:58.219117 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:58.231370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1420/2884] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:58.340259 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:58.341628 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:58.341963 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:58.360841 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:00:58.362051 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:58.423318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1465/2885] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:00:58.452387 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:58.485847 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:00:58.487782 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:58.534369 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748920e0-2d64-4cf2-bbd3-2f24ff1a2096 service glance] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:58.538375 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:58.539032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:58.539310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:58.540342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:58.542497 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:00:58.560631 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:58.562330 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:58.576560 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1421/2886] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:00:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:00:58.593652 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d018-6d48-43c4-a0a8-c1903c939eca None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:00:58.599094 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:00:58.599799 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:00:58.600076 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:00:58.600400 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:00:58.610662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:00:58.612336 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06d9b7-5fc4-4708-8c28-3b88e1ebd6d3 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:00:58.621601 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1466/2887] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 15:00:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 15:01:08.662010 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:08.663753 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:08.760439 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd318c2-537d-4d53-9ca1-f938c829e669 service neutron] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:08.766336 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:08.767119 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:08.767476 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:08.767842 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:08.770028 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:08.783646 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:08.785373 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:08.801355 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1422/2888] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:01:08.978795 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:08.979457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:08.979457 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:08.997666 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] MFA Rules not processed for user `363be0596af84866bc099452ba5aabd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:01:08.998892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:09.007849 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1467/2889] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:01:09.308012 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:09.309625 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:09.322626 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6076015-d64e-4440-9b90-dd8b6acb3354 service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:09.326610 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:09.327276 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:09.327555 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:09.327858 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:09.329986 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:09.344258 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:09.346057 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b071-991a-45b6-9964-769adae663f3 service neutron] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:09.355749 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1423/2890] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:01:10.005268 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:10.006783 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:10.096255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58db78-8c69-4d19-a89d-267d0f144c4f None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:10.101313 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:10.102009 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:10.102261 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:10.102616 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:10.105134 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:10.118735 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:10.120429 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:10.132890 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1468/2891] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:01:11.399508 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4565-9506-4c20-a009-03f817cb68b3 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:11.400342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4565-9506-4c20-a009-03f817cb68b3 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:11.400342 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4565-9506-4c20-a009-03f817cb68b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:11.419492 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-e04f4565-9506-4c20-a009-03f817cb68b3 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:01:11.420924 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-e04f4565-9506-4c20-a009-03f817cb68b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:11.428431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1424/2892] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:01:11.441211 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:11.453901 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c9a-e5ca-4a79-9fcd-ed6887dd927f service placement] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:11.459876 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:11.460524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:11.460807 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:11.461074 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:11.470869 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:11.472524 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:11.482577 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1469/2893] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 15:01:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 15:01:11.658166 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:11.658980 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:11.660179 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:11.709418 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:01:11.712282 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:11.747279 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1425/2894] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:01:11.767744 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:11.816711 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ad95-157c-4af3-b0cb-6ce3702bbc62 service swift] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:11.825812 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:11.827439 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:11.828235 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:11.828946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:11.853424 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:11.856508 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6c8e-30f4-43df-b371-45fc99790cb7 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:11.898825 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1470/2895] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 15:01:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 15:01:31.220650 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:31.241780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8ec5-b115-4838-84f8-c07d90341ae7 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:31.249678 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:31.250376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:31.250774 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:31.251261 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:31.254603 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:31.271852 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:31.273409 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:31.286534 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1426/2896] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:01:31.500255 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] REQUEST_METHOD: `POST` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:31.500919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:31.500919 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:31.531982 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.auth.core [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86303) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:01:31.533126 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:31.543559 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1471/2897] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 15:01:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 15:01:31.561389 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:31.576133 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31f93-2b44-47ea-8cf4-e22d51726bfa service nova] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:31.581571 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:31.582716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:31.583206 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:31.583700 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:31.597769 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:31.599697 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:31.615174 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1427/2898] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 15:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 15:01:33.747635 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:33.750341 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:33.828044 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed53f-0ad1-4c51-a67c-872c6edec52e None None] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:33.833264 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:33.834203 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:33.834511 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:33.834806 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] PATH_INFO: `/v3/users/c406be4111cb4c8cae0464d09b140a36` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:33.836140 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c406be4111cb4c8cae0464d09b140a36)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:33.838217 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:33.895496 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c406be4111cb4c8cae0464d09b140a36'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:33.904892 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c406be4111cb4c8cae0464d09b140a36'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:33.913444 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c406be4111cb4c8cae0464d09b140a36'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:33.926303 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c406be4111cb4c8cae0464d09b140a36'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:33.927023 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c406be4111cb4c8cae0464d09b140a36'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:33.933482 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1472/2899] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:01:33 2022] DELETE /identity/v3/users/c406be4111cb4c8cae0464d09b140a36 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:01:34.144048 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:34.162280 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc8e65-6258-42f7-aff3-86d7df3dc1e8 service swift] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:34.239459 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:34.240385 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:34.240784 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:34.241062 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] PATH_INFO: `/v3/projects/5e7eb8d9d7ff4e83bfcd7bb6831f27e4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:34.242376 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7eb8d9d7ff4e83bfcd7bb6831f27e4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:34.244382 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:34.299443 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7eb8d9d7ff4e83bfcd7bb6831f27e4', 'request_id': 'req-5e2af752-4a88-4a69-bd6b-919ece804f6e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:34.306975 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7eb8d9d7ff4e83bfcd7bb6831f27e4', 'request_id': 'req-5e2af752-4a88-4a69-bd6b-919ece804f6e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:34.316240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7eb8d9d7ff4e83bfcd7bb6831f27e4', 'request_id': 'req-5e2af752-4a88-4a69-bd6b-919ece804f6e'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:34.330473 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] The token cache is being invalidate because project 5e7eb8d9d7ff4e83bfcd7bb6831f27e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:01:34.330780 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:34.331644 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:01:34.334524 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1428/2900] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:01:34 2022] DELETE /identity/v3/projects/5e7eb8d9d7ff4e83bfcd7bb6831f27e4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:01:38.691392 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:38.693161 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:38.757302 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fbbeb-6e20-4cdf-b368-8c76fee0813f admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:38.814654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735bc87032af455c8900fafe88496ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:38.815318 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:38.815603 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:38.815912 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:38.817946 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:38.887232 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:38.888659 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:38.900047 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1473/2901] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:01:40.657001 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:01:40.658481 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:40.746071 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af752-4a88-4a69-bd6b-919ece804f6e admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:01:40.751746 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9052eeac18b49d79f81f1a3ec919c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:01:40.752421 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] REQUEST_METHOD: `GET` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:01:40.752699 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:01:40.752961 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:01:40.754798 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:01:40.768426 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:01:40.770391 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06ae5f-3c74-4d68-b5c9-148205a340c4 service nova] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:01:40.784013 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1429/2902] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:04:06.181526 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:06.182900 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:06.343120 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c60c-8086-4d4b-91a5-448a20696ce3 service neutron] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:06.349167 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac72e2a7a2c40dea1cb3ebe1a2f3d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:06.350016 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:06.350327 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:06.350602 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:06.352531 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:06.365522 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:06.367173 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:06.378295 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1474/2903] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 15:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 15:04:07.259240 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] REQUEST_METHOD: `POST` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:07.259816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:07.259816 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:07.294039 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.auth.core [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] MFA Rules not processed for user `9a66dd362d8f445f9c8f4027c4bd4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 15:04:07.295226 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:07.360585 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1430/2904] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 15:04:07.410965 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:07.412548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:07.486427 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11e83-c22c-4f61-9552-d008c1bd79b5 service placement] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:07.491420 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66ba10ffb7804f6e9a05ae87d2c249c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3accb6964814c09a848544b57230884', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:07.492107 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] REQUEST_METHOD: `GET` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:07.492383 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:07.492654 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:07.501170 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:07.502742 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:07.510940 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1475/2905] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 15:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 15:04:14.567724 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:14.570032 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:14.670158 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ea786-0c22-4979-b233-328742a99567 None None] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:14.674716 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:14.675609 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:14.675992 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:14.676262 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] PATH_INFO: `/v3/users/363be0596af84866bc099452ba5aabd4` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:14.677472 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363be0596af84866bc099452ba5aabd4)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:14.679431 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:14.727433 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363be0596af84866bc099452ba5aabd4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:14.728136 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363be0596af84866bc099452ba5aabd4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:14.735252 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363be0596af84866bc099452ba5aabd4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:14.735898 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363be0596af84866bc099452ba5aabd4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:14.744181 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363be0596af84866bc099452ba5aabd4'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:14.760692 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1431/2906] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:04:14 2022] DELETE /identity/v3/users/363be0596af84866bc099452ba5aabd4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:04:14.940390 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:14.955871 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf16ae-266f-42a3-85a2-7c3545be9a92 service swift] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:15.027850 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:15.028729 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:15.029011 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:15.029285 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] PATH_INFO: `/v3/projects/0ddd059d96794328b377382ffa0bb824` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:15.030537 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddd059d96794328b377382ffa0bb824)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:15.032487 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:15.088331 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddd059d96794328b377382ffa0bb824', 'request_id': 'req-62d9312e-3cd9-4081-b1e7-d85331267bdd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.094425 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddd059d96794328b377382ffa0bb824', 'request_id': 'req-62d9312e-3cd9-4081-b1e7-d85331267bdd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.103447 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddd059d96794328b377382ffa0bb824', 'request_id': 'req-62d9312e-3cd9-4081-b1e7-d85331267bdd'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.117964 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] The token cache is being invalidate because project 0ddd059d96794328b377382ffa0bb824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:04:15.118221 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.119270 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.122022 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1476/2907] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:04:14 2022] DELETE /identity/v3/projects/0ddd059d96794328b377382ffa0bb824 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:04:15.126370 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Authenticating user token {{(pid=86302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:15.127993 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.fernet_utils [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:15.141948 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd4e9-5f95-4568-aec8-09f2adccba49 admin admin] Validating token access rules against request {{(pid=86302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:15.203310 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:15.204115 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:15.204392 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:15.204660 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] PATH_INFO: `/v3/users/7cb0a943e74f4d79ad1b4d2d51032270` {{(pid=86302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:15.205872 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb0a943e74f4d79ad1b4d2d51032270)` {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:15.207867 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] RBAC: Authorization granted {{(pid=86302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:15.259600 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb0a943e74f4d79ad1b4d2d51032270'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.260300 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb0a943e74f4d79ad1b4d2d51032270'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.267114 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb0a943e74f4d79ad1b4d2d51032270'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.267760 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb0a943e74f4d79ad1b4d2d51032270'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.277498 dv-cinder-840493-1-smb devstack@keystone.service[86302]: DEBUG keystone.notifications [None req-90b53eb2-671f-467f-8c61-c790718475ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb0a943e74f4d79ad1b4d2d51032270'} {{(pid=86302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.297742 dv-cinder-840493-1-smb devstack@keystone.service[86302]: [pid: 86302|app: 0|req: 1432/2908] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 15:04:15 2022] DELETE /identity/v3/users/7cb0a943e74f4d79ad1b4d2d51032270 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 15:04:15.483177 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Authenticating user token {{(pid=86303) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 15:04:15.484683 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.fernet_utils [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86303) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 15:04:15.499891 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9312e-3cd9-4081-b1e7-d85331267bdd admin admin] Validating token access rules against request {{(pid=86303) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 15:04:15.574662 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fff94fab47494ebebc775758ec7bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3035cf84fc44f4baa2938e61d4c1c06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86303) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 15:04:15.575575 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 15:04:15.575909 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 15:04:15.576188 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] PATH_INFO: `/v3/projects/083851306ec341048c5bae3d3fb70d7c` {{(pid=86303) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 15:04:15.577443 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083851306ec341048c5bae3d3fb70d7c)` {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 15:04:15.579411 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] RBAC: Authorization granted {{(pid=86303) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 15:04:15.634584 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083851306ec341048c5bae3d3fb70d7c', 'request_id': 'req-6af83025-9f61-4221-ace0-090f4f987076'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.641548 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083851306ec341048c5bae3d3fb70d7c', 'request_id': 'req-6af83025-9f61-4221-ace0-090f4f987076'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.652137 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083851306ec341048c5bae3d3fb70d7c', 'request_id': 'req-6af83025-9f61-4221-ace0-090f4f987076'} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.663160 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] The token cache is being invalidate because project 083851306ec341048c5bae3d3fb70d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86303) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 15:04:15.663441 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.664218 dv-cinder-840493-1-smb devstack@keystone.service[86303]: DEBUG keystone.notifications [None req-6af83025-9f61-4221-ace0-090f4f987076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86303) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 15:04:15.665881 dv-cinder-840493-1-smb devstack@keystone.service[86303]: [pid: 86303|app: 0|req: 1477/2909] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 15:04:15 2022] DELETE /identity/v3/projects/083851306ec341048c5bae3d3fb70d7c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)